-- Logs begin at Mon 2022-09-19 16:29:35 UTC, end at Mon 2022-09-19 17:51:25 UTC. -- Sep 19 17:14:00.678668 dv-cinder-848013-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 17:14:00.687534 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 17:14:00 2022] *** Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: nodename: dv-cinder-848013-2-iscsi Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: machine: x86_64 Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: clock source: unix Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: pcre jit disabled Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: detected number of CPU cores: 4 Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: current working directory: / Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: detected binary path: /usr/bin/uwsgi-core Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: your processes number limit is 47680 Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: your memory page size is 4096 bytes Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: detected max file descriptor number: 2048 Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: lock engine: pthread robust mutexes Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: thunder lock: enabled Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 17:14:00.695624 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 17:14:00.729420 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: Python main interpreter initialized at 0x556bb8d9a9c0 Sep 19 17:14:00.729420 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: python threads support enabled Sep 19 17:14:00.729420 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: your server socket listen backlog is limited to 100 connections Sep 19 17:14:00.729420 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: your mercy for graceful operations on workers is 90 seconds Sep 19 17:14:00.729983 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 17:14:00.729983 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: *** Operational MODE: preforking *** Sep 19 17:14:00.730259 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: *** uWSGI is running in multiple interpreter mode *** Sep 19 17:14:00.730259 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: spawned uWSGI master process (pid: 106095) Sep 19 17:14:00.730360 dv-cinder-848013-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 17:14:00.731866 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: spawned uWSGI worker 1 (pid: 106096, cores: 1) Sep 19 17:14:00.731866 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: spawned uWSGI worker 2 (pid: 106097, cores: 1) Sep 19 17:14:00.731866 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 17:14:01.406088 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 17:14:01.406719 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 17:14:02.508382 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 17:14:02.508382 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: from cryptography.utils import int_from_bytes Sep 19 17:14:02.509010 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 17:14:02.509010 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: from cryptography.utils import int_from_bytes Sep 19 17:14:02.514938 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 17:14:02.514938 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: from cryptography.utils import int_from_bytes Sep 19 17:14:02.515361 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 17:14:02.515361 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: from cryptography.utils import int_from_bytes Sep 19 17:14:05.005125 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 17:14:05.005801 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 17:14:05.005899 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 17:14:05.006277 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 17:14:05.006537 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 17:14:05.006933 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.007264 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.007592 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.007961 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.008299 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.008402 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 17:14:05.008767 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.008855 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 17:14:05.008948 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.009179 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 17:14:05.009282 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.009545 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 17:14:05.009642 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.009807 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 17:14:05.009899 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.010125 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.010216 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.010457 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848013-2-iscsi {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.010556 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.010783 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.010874 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.011096 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.011188 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.011422 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.011520 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.011751 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.011852 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.012062 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.012152 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.012380 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.012463 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.012698 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.012795 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.012955 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.013206 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.013312 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.013579 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848013-2-iscsi {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.013702 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.013902 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.014024 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.014209 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.014347 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.014523 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.014657 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.014842 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.015033 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.015188 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.015282 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.015454 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.015570 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.015781 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.015884 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.016158 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.016287 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.016475 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.016596 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.016879 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848013-2-iscsi {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.016965 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.017197 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.017334 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.017511 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.017596 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.017828 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.017963 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.018133 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.018249 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.018451 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.018563 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.018757 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.018876 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.019099 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.019229 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.019409 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.019557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.019830 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848013-2-iscsi {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.019934 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.020144 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.020316 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.020453 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.020541 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.020764 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.020858 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.021149 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.021252 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.021458 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.021558 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.021761 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.021852 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.022073 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.022168 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.022398 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.022495 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.022703 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.022793 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.023027 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.023149 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.023335 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.023420 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.023649 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.023763 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.023991 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.024089 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.024291 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.024377 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.024597 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.024689 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.024884 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.025025 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.025134 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.025227 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.025439 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.025548 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.025764 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.025867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.026026 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.026118 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.026332 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.026428 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.026651 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.026736 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.026964 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.027049 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.027275 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.027368 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.027523 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.027614 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.027792 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.027909 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.028112 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.028207 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.028433 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.028526 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.028739 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.028843 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.029046 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.029138 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.029350 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.029436 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.029661 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.029747 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.029964 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.030137 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.030268 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.030392 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.030572 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.030750 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.030876 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.031100 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.031186 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.031425 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.031518 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.031763 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.031866 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.032092 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.032189 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.032419 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.032504 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.032730 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.032826 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.033042 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.033127 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.033346 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.033431 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.033671 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.033756 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.033988 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.034073 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.034297 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.034391 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.034550 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.034633 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.034880 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.034965 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.035191 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.035293 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.035516 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.035616 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.035843 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.035946 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.036152 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.036250 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.036465 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.036553 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.036772 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.036859 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.037017 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.037111 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.037317 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.037408 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.037620 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.037705 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.037937 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.038030 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.038242 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.038336 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.038547 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.038638 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.038853 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.038939 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.039152 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.039245 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.039457 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.039542 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.039787 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.039887 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.040117 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.040203 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.040441 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.040534 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.040994 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.041085 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.041304 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.041396 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.041608 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.041702 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.041914 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.042007 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.042217 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.042313 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.042520 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.042611 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.042827 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.042913 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.043144 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.043230 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.043450 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.043541 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.043776 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.043875 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.044083 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.044179 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.044387 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.044480 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.044696 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.044781 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.044999 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.045084 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.045305 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.045406 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.045613 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.045702 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.045915 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.046019 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.046224 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.046366 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.046529 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.046641 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.046836 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.046955 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.047138 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.047304 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.047430 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.047596 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.047763 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.047930 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.048072 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.048240 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.048380 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.048558 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.048686 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.048868 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.049010 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.049179 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.049332 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.049475 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.049633 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.049786 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.049945 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.050090 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.050255 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.050932 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.051102 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.051251 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.051440 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.051815 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.052172 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.052349 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.052575 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.052706 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.052898 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.053047 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.053225 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.053359 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.053537 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.053685 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.053833 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.053965 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.054144 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.054290 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.054466 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:14:05.054610 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.054794 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.054933 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.055112 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.055246 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.055431 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.055570 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.055782 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.055873 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.056112 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.056198 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.056445 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.056542 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.056767 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.056854 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.057082 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.057167 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.057399 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.057509 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.057715 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.057803 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.058026 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.058111 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.058338 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.058432 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.058651 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.058738 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.058973 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.059066 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.059295 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.059381 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.059627 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.059749 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.059974 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.060067 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.060296 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.060383 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.060616 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.060702 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.060931 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.061017 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.061262 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.061356 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.061564 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.061654 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.061891 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.062031 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.062185 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.062274 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.062520 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.062658 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.062845 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.063030 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.063172 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.063301 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.063483 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.063614 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.063827 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.063985 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.064145 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.064286 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.064464 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.064600 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.064784 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.064879 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.065102 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.065188 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.065447 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.065533 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.065771 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.065906 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.066151 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.066333 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.066499 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.066645 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.066822 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.067216 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.067369 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.068161 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.068332 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.068471 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.068714 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.068865 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.069104 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.069246 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.069435 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.069435 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.070334 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.070472 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.070885 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.070885 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.071293 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.071445 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.071608 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.071801 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.071955 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.072118 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.072278 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.072439 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.072672 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.072830 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.073021 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.073243 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.073399 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.073672 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.073832 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.073983 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.074233 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.074397 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.074542 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.074861 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.075017 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.075177 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.075430 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.075650 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.075927 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.076179 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.076331 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.076477 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.076622 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.076771 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.077007 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.077176 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.077327 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.077596 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.077761 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.077909 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.078152 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.078320 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.078513 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.078710 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.078879 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.079137 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.079305 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.079454 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.079775 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.079956 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.080107 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.080329 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.080501 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.080693 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.080877 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.081031 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.081321 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.081455 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.081660 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.081954 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.082127 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.082299 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.082500 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.082655 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.082926 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.083075 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.083255 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.083520 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.083663 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.083914 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.084089 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.084240 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.084519 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.084660 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.084823 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.085112 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.085272 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.085419 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.085673 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.085844 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.086003 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.086217 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.086370 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.086592 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.086746 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.086903 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.087186 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.087366 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.087508 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.087830 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.087971 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.088143 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.088403 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.088563 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.088709 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.088962 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.089121 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.089330 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.089530 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.089695 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.090003 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.090158 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.090359 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.090574 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.090761 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.090942 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.091141 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.091383 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.091562 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.091756 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.091905 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.092211 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.092369 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.092516 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.092750 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.092926 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.093131 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.093296 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.093505 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.093751 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.093907 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.094069 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.094340 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.094499 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.094684 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.094893 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.095062 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.095295 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.095457 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.095634 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.095995 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.096209 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.096360 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.096574 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.096732 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.096922 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.097133 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.097837 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.098140 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.098237 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.098454 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.098602 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.098768 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.099055 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.099150 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.099386 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.099541 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.099713 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.100097 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.100200 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.100407 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.100562 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.100734 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.100995 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.101089 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.101358 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.101486 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.101674 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.101848 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.102017 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.102308 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.102480 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.102636 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.102887 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.103060 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.103240 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.103453 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.103627 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.103891 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.104075 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.104226 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.104501 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.104668 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.104832 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.105063 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.105223 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.105399 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.105629 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.105795 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.106048 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.106253 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.106471 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.106621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.106829 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.107001 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.107203 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.107398 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.107584 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.107786 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.107994 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.108172 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.108401 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.108552 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.108711 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.109019 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.109175 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.109337 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.109569 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.109736 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.109924 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.110134 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.110309 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.110574 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.110745 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.110911 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.111138 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.111320 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.111487 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.111801 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.112020 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.112262 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.112480 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.112691 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.113521 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.113521 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.113964 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.114188 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.114404 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.114629 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.114629 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.115056 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.115269 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.115269 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.115686 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.115941 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.115941 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.116361 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.116575 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.116575 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.116848 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.117002 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.117002 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.117296 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.117440 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.117590 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.117797 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.117961 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.118104 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.118248 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.118395 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.118626 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.118783 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.118974 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.119201 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.119565 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.119784 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.119934 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.120212 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.120390 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.120549 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.120760 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.120916 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.121182 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.121353 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.121501 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.121813 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.121973 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.122161 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.122392 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.122551 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.122708 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.122945 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.123113 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.123305 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.123512 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.123666 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.123939 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.124091 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.124260 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.124540 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.124699 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.124846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.125123 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.125280 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.125427 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.125663 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.125829 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.126022 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.126247 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.126399 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.126630 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.126840 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.126990 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.127236 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.127417 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.127567 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.127830 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.127987 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.128152 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.128387 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.128543 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.128778 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.128931 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.129125 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.129434 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.129612 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.129760 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.129986 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.130142 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.130421 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.130586 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.130755 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.131005 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.131148 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.131499 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.131656 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.131923 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.132160 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.132319 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.132525 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.132728 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.133168 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.133347 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.133518 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.133742 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.133908 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.134173 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.134326 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.134486 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.134780 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.134937 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.135172 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.135325 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.135678 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.135900 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.136326 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.136497 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.136777 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.137000 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.137241 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.137472 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.137686 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.137910 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.138137 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.138412 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.138641 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.138874 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.139086 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.139301 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.139301 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.139758 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.140009 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.140009 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.140442 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.140661 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.140661 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.141059 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.141285 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.141285 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.141698 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.141911 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.141911 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.142315 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.142541 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.142541 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.142967 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.143192 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.143192 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.143611 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.143860 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.143860 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.144259 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.144482 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.144482 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.144908 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.145121 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.145121 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.145553 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.145776 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.145776 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.146303 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.146570 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.146570 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.146991 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.147202 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.147202 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.147615 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.147842 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.147842 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.148241 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.148468 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.148468 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.148884 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.149109 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.149329 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.149538 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.149538 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.149944 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.150157 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.150157 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.150555 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.150765 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.150765 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.151216 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.151425 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.151425 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.151853 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.152064 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.152064 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.152366 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.152525 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.152525 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.152525 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.152914 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.153074 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.153074 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.153344 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.153504 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.153504 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.153772 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.153931 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.153931 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.154200 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.154346 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.154346 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.154624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.154803 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.154970 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.155124 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.155272 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.155562 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.155804 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.155955 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.156173 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.156329 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.156514 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.156732 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.156889 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.157126 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.157289 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.157448 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.157735 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.157889 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.158036 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.158301 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.158474 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.158623 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.158841 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.158999 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.159236 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.159410 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.159598 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.160402 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.160559 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.160852 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.161011 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.161179 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.161432 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.161592 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.161792 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.161984 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.162154 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.162401 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.162552 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.162700 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.163002 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.163159 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.163324 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.163553 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.163780 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.164066 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.164220 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.164369 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.164624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.164783 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.164967 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.165177 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.165332 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.165579 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.165999 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.166147 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.166451 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.166620 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.166781 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.167016 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.167246 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.167460 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.167610 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.167783 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.168087 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.168299 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.168476 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.168621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.168767 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.168980 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.169167 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.169336 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.169601 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.169751 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.169899 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.170199 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.170353 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.170514 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.170796 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.170954 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.171101 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.171352 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.171508 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.171858 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.172012 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.172161 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.172433 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.172589 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.172866 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.173041 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.173190 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.173461 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.173620 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.173779 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.174010 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.174169 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.174398 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.174547 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.174696 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.175009 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.175178 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.175339 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.176184 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.176341 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.176529 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.176742 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.176925 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.177140 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.177303 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.177450 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.177766 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.177925 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.178094 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.178316 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.178485 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.178792 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.178945 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.179106 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.179340 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.179500 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.179741 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.179896 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.180074 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.180374 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.180522 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.180670 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.180955 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.181113 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.181259 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.181502 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.181660 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.181881 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.182032 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.182181 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.182489 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.182666 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.182815 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.183087 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.183244 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.183390 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.183633 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.183813 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.184015 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.184230 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.184388 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.184638 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.184806 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.184963 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.185254 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.185412 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.185569 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.185795 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.185965 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.186173 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.186357 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.186510 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.186778 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.187005 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.187168 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.187372 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.187526 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.187739 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.187953 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.188131 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.188360 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.188513 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.188691 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.188990 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.189148 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.189309 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.189528 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.189686 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.189958 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.190111 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.190275 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.190584 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.190742 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.190903 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.191150 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.191308 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.191555 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.191750 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.191905 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.192192 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.192368 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.192515 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.192735 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.192892 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.193082 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.193285 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.193441 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.193685 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.193851 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.194000 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.194284 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.194448 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.194596 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.194866 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.195046 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.195197 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.195411 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.195590 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.195808 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.195997 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.196174 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.196401 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.196552 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.196744 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.197033 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.197214 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.197425 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.197571 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.197715 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.197979 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.198144 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.198305 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.198591 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.198751 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.198936 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.199145 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.199301 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.199510 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.199719 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.199894 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.200151 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.200306 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.200453 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.200748 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.200907 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.201072 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.201374 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.201533 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.201868 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.202040 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.202246 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.202416 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.202565 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.202873 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.203028 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.203175 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.203429 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.203589 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.203814 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.204059 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.204220 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.204433 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.204605 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.204760 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.205046 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.205210 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.205359 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.205645 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.205820 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.206029 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.206217 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.206381 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.206697 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.206867 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.207014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.207279 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.207438 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.207597 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.207867 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.208044 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.208296 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.208448 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.208609 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.208899 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.209069 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.209231 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.209462 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.209619 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.209815 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.210017 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.210186 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.210432 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.210585 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.210733 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.211041 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.211199 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.211367 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.211585 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.211829 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.211979 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.212193 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.212351 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.212606 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.212759 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.212908 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.213220 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.213382 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.213541 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.213788 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.213947 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.214297 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.214455 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.214644 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.214872 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.215044 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.215291 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.215444 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.215592 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.215939 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.216136 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.216284 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.216500 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.216668 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.216857 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.217069 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.217304 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.217466 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.217668 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.217831 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.218047 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.218197 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.218360 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.218667 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.218881 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.219030 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.219222 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.219393 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.219571 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.219811 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.220130 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.220305 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.220466 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.220783 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.220939 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.221111 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.221345 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.221502 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.221736 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.221902 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.222139 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.222908 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.223063 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.223213 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.223460 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.223630 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.223859 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.224061 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.224216 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.224441 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.224620 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.224769 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.225051 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.225204 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.225352 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.225605 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.225786 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.225938 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.226149 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.226392 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.226543 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.226713 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.226886 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.227137 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.227292 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.227437 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.227762 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.227972 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.228130 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.228367 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.228518 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.228665 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.228967 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.229136 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.229285 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.229524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.229693 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.229869 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.230085 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.230308 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.230472 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.230644 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.230830 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.231140 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.231283 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.231427 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.231669 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.231844 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.232079 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.232215 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.232384 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.232705 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.232876 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.233013 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.233328 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.233467 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.233643 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.233881 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.234023 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.234294 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.234433 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.234615 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.234883 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.235150 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.235391 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.235534 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.236164 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.236324 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.236501 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.236501 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.236849 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.237001 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.237149 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.237306 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.237515 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.237665 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.237927 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.238564 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.238709 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.238869 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.239170 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.239326 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.239474 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.239775 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.239935 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.240203 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.240351 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.240513 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.240702 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.241014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.241167 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.241332 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.241567 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.241803 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.241954 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.242100 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.242275 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.242508 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.242811 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.242971 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.243153 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.243366 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.243539 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.243810 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.243983 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.244134 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.244435 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.244590 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.244760 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.244995 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.245165 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.245343 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.245576 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.245761 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.245976 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.246126 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.246274 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.246581 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.246736 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.246898 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.247140 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.247575 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.247782 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.247934 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.248177 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.248350 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.248550 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.248716 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.248864 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.249181 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.249335 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.249652 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.249808 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.249956 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.250123 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.250322 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.250493 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.250738 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.250891 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.251076 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.251384 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.251544 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.251740 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.251977 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.252152 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.252346 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.252657 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.252813 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.252977 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.253217 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.253387 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.253592 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.253802 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.253972 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.254191 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.254374 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.254537 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.254795 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.254958 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.255120 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.255460 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.255620 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.255815 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.255964 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.256092 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.256305 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.256519 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.256687 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.256905 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.257057 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.257204 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.257505 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.257722 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.257873 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.258081 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.258229 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.258391 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.258631 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.258788 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.258977 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.259188 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.259354 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.259576 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.259820 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.259971 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.260255 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.260410 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.260559 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.260821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.260990 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.261185 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.261369 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.261524 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.261816 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.261984 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.262133 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.262398 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.262558 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.262754 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.262971 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.263128 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.263391 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.263543 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.263745 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.264034 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.264212 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.264365 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.264601 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.264759 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.264941 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.265147 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.265318 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.265572 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.265725 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.265901 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.266189 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.266350 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.266513 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.266733 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.266892 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.267135 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.267298 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.267459 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.267767 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.267926 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.268104 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.268357 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.268516 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.268717 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.268907 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.269086 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.269402 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.269557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.269718 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.269988 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.270158 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.270306 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.270551 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.270710 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.270930 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.271093 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.271240 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.271571 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.271759 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.271909 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.272173 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.272331 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.272535 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.272732 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.272899 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.273195 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.273364 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.273525 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.273777 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.273947 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.274164 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.274332 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.274480 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.274776 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.274931 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.275079 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.275312 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 17:14:05.275478 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.275859 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.276334 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.276751 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.277169 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.277589 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.278013 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.278432 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.278848 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.279279 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.279737 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.280178 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.280610 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.281024 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.281437 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.281849 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.282305 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.282730 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.283165 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.283586 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.284060 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.284494 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.285447 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.285883 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.286341 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.286739 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.287117 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.287495 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.287918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.288356 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.288783 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.289221 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.289885 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.290324 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.291050 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.291481 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.291944 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.292368 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.292793 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.293222 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.293652 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.294080 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.294506 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.294943 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.295370 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.295839 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.296293 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.296774 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.297204 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.297635 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.298061 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.298529 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.299004 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.299430 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.299935 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.300488 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.301430 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.301863 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.302377 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.302809 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.303234 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.303666 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.304118 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.304560 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.304985 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.305427 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.305880 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.306312 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.306858 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.307292 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.307741 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.308431 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.308889 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.309337 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.309782 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.310240 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.310671 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.311131 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.311590 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.312043 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.312471 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.312899 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.313320 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.313738 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.314168 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.314592 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.315016 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.315447 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.315916 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.316640 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.317107 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.317542 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.317980 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.318422 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.318849 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.319264 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.319747 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.320164 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.320578 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.321004 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.321423 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.321843 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.322257 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.322686 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.323293 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.323737 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.324164 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.324586 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.325026 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.325457 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.325873 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.326287 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.326708 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.327129 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.327559 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.328002 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.328424 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.328849 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.329271 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.329689 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.330109 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.330553 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.331019 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.331438 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.331963 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.332412 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.332836 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.333253 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.333685 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.334112 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.334556 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.334986 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.335416 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.335934 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.336363 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.337066 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.337552 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.337987 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.338434 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.338870 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.339287 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.339733 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.340143 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.340589 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.341016 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.341436 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.341855 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.342272 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.342691 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.343118 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.343537 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.343990 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.344418 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.344839 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.345271 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.345694 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.346119 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.346548 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.346976 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.348015 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.348459 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.348889 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.349315 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.349788 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.350209 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.350629 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.351055 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.351484 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.352022 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.352488 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.352921 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.353345 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.354195 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.354630 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.355063 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.355494 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.355969 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.356416 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.356850 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.357272 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.357701 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.358205 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.358729 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.359466 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.359723 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.360248 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.360757 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.361242 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.361727 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.362226 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.364920 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.364920 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.364920 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.364920 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.365762 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.365762 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.366195 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.366683 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.367131 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.367602 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.368080 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.368521 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.368961 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.369401 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.369835 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.370263 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.370689 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.371134 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.371560 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.372011 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.372457 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.372884 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.373345 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.373793 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.374222 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.374749 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.375180 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.375613 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.376073 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.376509 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.376943 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.377374 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.377804 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.378246 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.378703 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.379127 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.379551 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.380128 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.380485 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.380907 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.381378 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.381812 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.382234 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.382702 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.383183 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.383621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.384073 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.384508 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.384968 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.385406 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.385827 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.386246 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.386669 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.387091 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.387520 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.387979 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.388400 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.388827 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.389252 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.389691 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.390127 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.390598 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.391058 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.391522 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.392009 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.392432 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.392900 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.393338 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.393767 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.394227 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.394646 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:14:05.394990 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 17:14:05.427951 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO dbcounter [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Registered counter for database nova_api Sep 19 17:14:05.450488 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_db.sqlalchemy.engines [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:14:05.457952 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writer thread running {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:14:05.517224 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.context [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb886613-25c5-4d71-85c4-935a7fe74cbe(cell1) {{(pid=106097) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 17:14:05.521590 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:14:05.522066 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:14:05.523643 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:14:05.524398 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:14:05.524839 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:14:05.526849 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:14:05.528865 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO dbcounter [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Registered counter for database nova_cell0 Sep 19 17:14:05.532988 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO dbcounter [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Registered counter for database nova_cell1 Sep 19 17:14:05.540996 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_db.sqlalchemy.engines [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:14:05.544766 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_db.sqlalchemy.engines [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:14:05.546565 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writer thread running {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:14:05.546663 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO dbcounter [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Registered counter for database nova_api Sep 19 17:14:05.566833 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG oslo_db.sqlalchemy.engines [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:14:05.573941 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writer thread running {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:14:05.631951 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.context [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb886613-25c5-4d71-85c4-935a7fe74cbe(cell1) {{(pid=106096) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 17:14:05.635839 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG oslo_concurrency.lockutils [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:14:05.636322 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG oslo_concurrency.lockutils [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:14:05.637925 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG oslo_concurrency.lockutils [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:14:05.638660 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG oslo_concurrency.lockutils [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:14:05.639113 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG oslo_concurrency.lockutils [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:14:05.641175 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG oslo_concurrency.lockutils [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:14:05.643184 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO dbcounter [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Registered counter for database nova_cell0 Sep 19 17:14:05.648012 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO dbcounter [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Registered counter for database nova_cell1 Sep 19 17:14:05.655170 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG oslo_db.sqlalchemy.engines [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:14:05.656455 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG oslo_db.sqlalchemy.engines [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:14:05.663373 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writer thread running {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:14:05.665634 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writer thread running {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:14:05.685388 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writer thread running {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:14:05.695302 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO dbcounter [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Registered counter for database nova_cell0 Sep 19 17:14:05.702392 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_db.sqlalchemy.engines [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:14:05.707535 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writer thread running {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:14:05.812742 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO dbcounter [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Registered counter for database nova_cell0 Sep 19 17:14:05.822211 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG oslo_db.sqlalchemy.engines [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:14:05.827348 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writer thread running {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:14:06.110222 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: WARNING keystonemiddleware.auth_token [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 17:14:06.117702 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: WARNING keystonemiddleware.auth_token [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 17:14:06.147405 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: WARNING keystonemiddleware.auth_token [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 17:14:06.154868 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: WARNING keystonemiddleware.auth_token [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 17:14:06.465772 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: WARNING keystonemiddleware.auth_token [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 17:14:06.471889 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: WARNING keystonemiddleware.auth_token [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 17:14:06.477430 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bb8d9a9c0 pid: 106097 (default app) Sep 19 17:14:06.479495 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:14:06.480759 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001791 Sep 19 17:14:06.481159 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Mon Sep 19 17:14:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:14:06.497741 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: WARNING keystonemiddleware.auth_token [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 17:14:06.504359 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: WARNING keystonemiddleware.auth_token [None req-db700c0a-6f0a-49bf-b606-5930b932c1d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 17:14:06.509563 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bb8d9a9c0 pid: 106096 (default app) Sep 19 17:15:32.218146 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:15:32.219583 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001957 Sep 19 17:15:32.220317 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:15:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:15:32.232953 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writing DB stats nova_api:SELECT=3 {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:32.233966 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writing DB stats nova_cell0:SELECT=3 {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:32.235374 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writing DB stats nova_cell1:SELECT=3 {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:32.236675 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writing DB stats nova_cell0:SELECT=3 {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:33.172739 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-5a088494-bd8d-47f0-a995-689306878d47 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:15:33.204605 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-5a088494-bd8d-47f0-a995-689306878d47 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.977350 Sep 19 17:15:33.211884 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1292 bytes} [Mon Sep 19 17:15:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:15:35.841953 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:15:35.842992 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-0bcc6c22-c371-44b9-884b-0bb1749658e5 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 19 17:15:35.843602 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:15:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:15:36.350819 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-8d5c797f-61fa-4e5b-b637-7feb4bd2f55e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:36.476687 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-8d5c797f-61fa-4e5b-b637-7feb4bd2f55e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.626368 Sep 19 17:15:36.477239 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Sep 19 17:15:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:15:36.495941 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writing DB stats nova_api:SELECT=3 {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:36.496805 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writing DB stats nova_cell1:SELECT=3 {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:36.498805 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writing DB stats nova_cell0:SELECT=3 {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:36.499596 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:36.711968 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-cdc2b06b-f5c7-44ab-a019-90eb9fca95b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:36.818091 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-cdc2b06b-f5c7-44ab-a019-90eb9fca95b0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.329614 Sep 19 17:15:36.818930 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1336 bytes} [Mon Sep 19 17:15:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:15:39.585227 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-8d5c797f-61fa-4e5b-b637-7feb4bd2f55e admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:15:39.586394 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-8d5c797f-61fa-4e5b-b637-7feb4bd2f55e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Sep 19 17:15:39.586936 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:15:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:15:40.434170 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-1507783c-37d6-4fc8-82f9-f5181ddbee6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:40.537775 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-1507783c-37d6-4fc8-82f9-f5181ddbee6d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.943849 Sep 19 17:15:40.539737 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Sep 19 17:15:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 17:15:40.551620 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-62a49d3d-f084-4201-8f63-aa8ac727144a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:40.665868 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-62a49d3d-f084-4201-8f63-aa8ac727144a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117731 Sep 19 17:15:40.671933 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1336 bytes} [Mon Sep 19 17:15:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:15:43.261538 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-1507783c-37d6-4fc8-82f9-f5181ddbee6d admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:15:43.262596 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-1507783c-37d6-4fc8-82f9-f5181ddbee6d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Sep 19 17:15:43.263077 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:15:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:15:43.680124 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-23f8abcc-662a-48e3-a669-6673d4f2471b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "id": "d2", "vcpus": 1, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:43.762877 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-23f8abcc-662a-48e3-a669-6673d4f2471b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492769 Sep 19 17:15:43.763459 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Sep 19 17:15:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:15:43.775652 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-a8c40613-d464-4699-8e00-c4d686b470fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:43.859686 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-a8c40613-d464-4699-8e00-c4d686b470fc admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087858 Sep 19 17:15:43.860360 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1336 bytes} [Mon Sep 19 17:15:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:15:46.492601 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-23f8abcc-662a-48e3-a669-6673d4f2471b admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:15:46.493618 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-23f8abcc-662a-48e3-a669-6673d4f2471b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 19 17:15:46.494182 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:15:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:15:46.991184 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-36f0c598-168a-432f-a88c-795660970c03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:47.055483 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-36f0c598-168a-432f-a88c-795660970c03 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.554827 Sep 19 17:15:47.056070 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Sep 19 17:15:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:15:47.068548 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-0c4e1831-5974-48c0-8cd1-d0f6f4384a59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:47.140447 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-0c4e1831-5974-48c0-8cd1-d0f6f4384a59 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074793 Sep 19 17:15:47.141462 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1336 bytes} [Mon Sep 19 17:15:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:15:49.802772 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-36f0c598-168a-432f-a88c-795660970c03 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:15:49.804225 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-36f0c598-168a-432f-a88c-795660970c03 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 Sep 19 17:15:49.804826 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:15:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:15:50.254539 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-1ab929bd-0efa-4334-8102-0cd43f01139c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "vcpus": 4}} {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:50.378076 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-1ab929bd-0efa-4334-8102-0cd43f01139c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.566689 Sep 19 17:15:50.379046 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Sep 19 17:15:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:15:50.395795 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-07531f8d-a0ef-4c1a-8046-294bbf7b3f23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:50.481407 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-07531f8d-a0ef-4c1a-8046-294bbf7b3f23 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092451 Sep 19 17:15:50.482579 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1336 bytes} [Mon Sep 19 17:15:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:15:53.221040 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-1ab929bd-0efa-4334-8102-0cd43f01139c admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:15:53.222059 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-1ab929bd-0efa-4334-8102-0cd43f01139c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 19 17:15:53.222466 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:15:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:15:53.691289 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-2059e157-dcab-4000-bb63-1d17e8e2562d admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:15:53.717037 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-2059e157-dcab-4000-bb63-1d17e8e2562d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.488148 Sep 19 17:15:53.718400 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1292 bytes} [Mon Sep 19 17:15:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:15:56.363848 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-1ab929bd-0efa-4334-8102-0cd43f01139c admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:15:56.364853 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-1ab929bd-0efa-4334-8102-0cd43f01139c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Sep 19 17:15:56.365634 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:15:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:15:56.789445 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-36d71c91-b2af-48f4-8376-30818783e940 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "1"}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:56.862346 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-36d71c91-b2af-48f4-8376-30818783e940 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.490679 Sep 19 17:15:56.862915 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Sep 19 17:15:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:15:56.878542 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-73784548-f419-4fd9-9048-34029ea67ffc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:15:56.984684 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-73784548-f419-4fd9-9048-34029ea67ffc admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112489 Sep 19 17:15:56.985282 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1333 bytes} [Mon Sep 19 17:15:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:15:59.665049 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-36d71c91-b2af-48f4-8376-30818783e940 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:15:59.666076 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-36d71c91-b2af-48f4-8376-30818783e940 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 19 17:15:59.666479 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:15:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:00.039720 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-e52e8424-27a2-41ce-9016-5bbb5c3bcc85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20}} {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:00.123329 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-e52e8424-27a2-41ce-9016-5bbb5c3bcc85 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.449647 Sep 19 17:16:00.124072 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Sep 19 17:15:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 17:16:00.136665 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-96e77b83-4473-4cf1-b72b-da14849252aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:00.214377 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-96e77b83-4473-4cf1-b72b-da14849252aa admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080362 Sep 19 17:16:00.214377 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1333 bytes} [Mon Sep 19 17:16:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:16:02.980370 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-e52e8424-27a2-41ce-9016-5bbb5c3bcc85 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:02.981804 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-e52e8424-27a2-41ce-9016-5bbb5c3bcc85 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001989 Sep 19 17:16:02.987733 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:16:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:03.445428 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-3792f438-edcf-4084-8371-0d9216d3f73d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "name": "m1.medium"}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:03.500249 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-3792f438-edcf-4084-8371-0d9216d3f73d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.509168 Sep 19 17:16:03.501525 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Sep 19 17:16:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:16:03.515052 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-55d358dd-367c-4a64-b3b3-187076f1ce2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:03.519534 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:03.589950 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-55d358dd-367c-4a64-b3b3-187076f1ce2e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079837 Sep 19 17:16:03.590600 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1333 bytes} [Mon Sep 19 17:16:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:16:06.247790 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-3792f438-edcf-4084-8371-0d9216d3f73d admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:06.249475 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-3792f438-edcf-4084-8371-0d9216d3f73d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 Sep 19 17:16:06.249974 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:06.708165 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-6d4deaef-35a1-4ee7-8668-0169a964f4bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large"}} {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:06.786476 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-6d4deaef-35a1-4ee7-8668-0169a964f4bc admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.529630 Sep 19 17:16:06.787225 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Sep 19 17:16:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:16:06.800261 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-43a3fe8e-8d57-4ee6-bda5-32dc8abf4ec3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:06.883494 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-43a3fe8e-8d57-4ee6-bda5-32dc8abf4ec3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086931 Sep 19 17:16:06.884494 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1333 bytes} [Mon Sep 19 17:16:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:16:09.509901 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-6d4deaef-35a1-4ee7-8668-0169a964f4bc admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:09.510918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-6d4deaef-35a1-4ee7-8668-0169a964f4bc admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 19 17:16:09.511324 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:16:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:09.953453 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-a73d9d28-ca79-4c50-be8f-9935be57f76d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "id": "5", "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:09.960322 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:10.043300 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-a73d9d28-ca79-4c50-be8f-9935be57f76d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.525230 Sep 19 17:16:10.043894 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Sep 19 17:16:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:16:10.056918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-0329c140-7318-401f-8e27-10ee5e1ff580 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:10.149652 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-0329c140-7318-401f-8e27-10ee5e1ff580 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096483 Sep 19 17:16:10.150591 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1333 bytes} [Mon Sep 19 17:16:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:16:27.587458 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-a73d9d28-ca79-4c50-be8f-9935be57f76d admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:27.588437 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-a73d9d28-ca79-4c50-be8f-9935be57f76d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Sep 19 17:16:27.588841 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:16:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:27.599524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:27.984142 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-842597e9-25dc-475a-94f3-c3c22a46b3ec admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:28.002725 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-842597e9-25dc-475a-94f3-c3c22a46b3ec admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407835 Sep 19 17:16:28.003263 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1292 bytes} [Mon Sep 19 17:16:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:16:29.321654 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-a73d9d28-ca79-4c50-be8f-9935be57f76d admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:29.322677 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-a73d9d28-ca79-4c50-be8f-9935be57f76d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 19 17:16:29.323074 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:16:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:29.850459 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-2c1bc57a-2caf-40a1-8eec-a7c6a2e5c0e5 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:29.855672 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.wsgi [None req-2c1bc57a-2caf-40a1-8eec-a7c6a2e5c0e5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-2c1bc57a-2caf-40a1-8eec-a7c6a2e5c0e5 admin admin] Request method failure captured: Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Accept: application/json Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Accept-Encoding: gzip, deflate Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Connection: keep-alive Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Content-Length: 0 Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Host: 10.222.0.61 Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Openstack-Api-Version: compute 2.92 Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Openstack-System-Scope: None Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: User-Agent: python-novaclient Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Auth-Token: gAAAAABjKKPt27Sgl_JQFBLZeWHZ4SxkR_bpzIL7HtE2NRSEJjj4ifig9d96SLSZj21EkQF2X6IuVMD9ohoxyrX603ZppllkVB9veYIpPJwiJat9QlKUXi41Wrbfh2M2A9ZztNd2_RCVWsuHhFCY2ErMlOblNDL23LnO6E5vCZ5MnDlf-Ybq6f0 Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Domain-Id: None Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Domain-Name: None Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Identity-Status: Confirmed Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Is-Admin-Project: True Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Domain-Id: default Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Domain-Name: Default Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Name: admin Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Role: reader,member,admin Sep 19 17:16:29.858937 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Roles: reader,member,admin Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4c5c785487de49b6a9006f75495cc370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}] Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Tenant: admin Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Tenant-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Tenant-Name: admin Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User: admin Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Domain-Id: default Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Domain-Name: Default Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Id: 6b446081736e459d86a67b4fd3fa5f03 Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Name: admin Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: method: > Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: exception: Flavor 42 could not be found. Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: action_args: {'id': '42'} Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:16:29.860621 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:29.861524 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:29.862821 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-2c1bc57a-2caf-40a1-8eec-a7c6a2e5c0e5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:16:29.864085 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-2c1bc57a-2caf-40a1-8eec-a7c6a2e5c0e5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.399304 Sep 19 17:16:29.864085 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Sep 19 17:16:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:29.870580 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-66dbaeb1-81f7-4be6-8814-24908738f304 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:29.893483 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-66dbaeb1-81f7-4be6-8814-24908738f304 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026835 Sep 19 17:16:29.895212 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Sep 19 17:16:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:16:29.904810 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-b8e9b848-4f9d-4ae0-bbb9-a4f717561ae4 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:29.927036 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-b8e9b848-4f9d-4ae0-bbb9-a4f717561ae4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026778 Sep 19 17:16:29.927574 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Sep 19 17:16:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:16:29.937572 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-964db2de-a04b-4003-ac3a-7c329ac8fd38 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:29.943344 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.wsgi [None req-964db2de-a04b-4003-ac3a-7c329ac8fd38 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-964db2de-a04b-4003-ac3a-7c329ac8fd38 admin admin] Request method failure captured: Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Accept: application/json Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Accept-Encoding: gzip, deflate Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Connection: keep-alive Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Content-Length: 0 Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Host: 10.222.0.61 Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Openstack-Api-Version: compute 2.92 Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Openstack-System-Scope: None Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: User-Agent: python-novaclient Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Auth-Token: gAAAAABjKKPt27Sgl_JQFBLZeWHZ4SxkR_bpzIL7HtE2NRSEJjj4ifig9d96SLSZj21EkQF2X6IuVMD9ohoxyrX603ZppllkVB9veYIpPJwiJat9QlKUXi41Wrbfh2M2A9ZztNd2_RCVWsuHhFCY2ErMlOblNDL23LnO6E5vCZ5MnDlf-Ybq6f0 Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Domain-Id: None Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Domain-Name: None Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Identity-Status: Confirmed Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Is-Admin-Project: True Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Domain-Id: default Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Domain-Name: Default Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Name: admin Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Role: reader,member,admin Sep 19 17:16:29.946621 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Roles: reader,member,admin Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4c5c785487de49b6a9006f75495cc370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}] Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Tenant: admin Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Tenant-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Tenant-Name: admin Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User: admin Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Domain-Id: default Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Domain-Name: Default Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Id: 6b446081736e459d86a67b4fd3fa5f03 Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Name: admin Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: method: > Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: exception: Flavor 42 could not be found. Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: action_args: {'id': '42'} Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:16:29.949014 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:29.950357 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:29.958846 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-964db2de-a04b-4003-ac3a-7c329ac8fd38 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:16:29.960191 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-964db2de-a04b-4003-ac3a-7c329ac8fd38 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014591 Sep 19 17:16:29.960191 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Sep 19 17:16:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 19 17:16:31.182645 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-b8e9b848-4f9d-4ae0-bbb9-a4f717561ae4 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:31.183720 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-b8e9b848-4f9d-4ae0-bbb9-a4f717561ae4 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 19 17:16:31.184140 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:16:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:31.713283 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-b2b8aa6c-72c0-4a6e-ba3f-d9f36e0b329c admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:31.717992 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.wsgi [None req-b2b8aa6c-72c0-4a6e-ba3f-d9f36e0b329c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-b2b8aa6c-72c0-4a6e-ba3f-d9f36e0b329c admin admin] Request method failure captured: Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Accept: application/json Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Accept-Encoding: gzip, deflate Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Connection: keep-alive Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Content-Length: 0 Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Host: 10.222.0.61 Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Openstack-Api-Version: compute 2.92 Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Openstack-System-Scope: None Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: User-Agent: python-novaclient Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Auth-Token: gAAAAABjKKPvTtm-7HuI1cvfdxX8LzgXYR-rTNwcK_Gp3fCLFNUElkcQVkNQfZpRUi6OoKYavnoC06z1_HKMWChJ1gLuxZ0FrYqzUap95Bl5AeTl0Z-CkZ_1Js8xqQFJ--92pkb-qy3VF4aIpfiXcwLBpggT91yPHla9bRWSNGoWREm6-NFULpQ Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Domain-Id: None Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Domain-Name: None Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Identity-Status: Confirmed Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Is-Admin-Project: True Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Domain-Id: default Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Domain-Name: Default Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Name: admin Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Role: reader,member,admin Sep 19 17:16:31.719490 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Roles: reader,member,admin Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4c5c785487de49b6a9006f75495cc370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}] Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Tenant: admin Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Tenant-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Tenant-Name: admin Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User: admin Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Domain-Id: default Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Domain-Name: Default Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Id: 6b446081736e459d86a67b4fd3fa5f03 Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Name: admin Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: method: > Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: exception: Flavor 84 could not be found. Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: action_args: {'id': '84'} Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:16:31.721105 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:31.722103 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:31.723496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-b2b8aa6c-72c0-4a6e-ba3f-d9f36e0b329c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:16:31.725054 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-b2b8aa6c-72c0-4a6e-ba3f-d9f36e0b329c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.396939 Sep 19 17:16:31.725054 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Sep 19 17:16:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:31.730794 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-f7cbdda4-830f-4b73-939d-e17abc495c90 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:31.746888 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-f7cbdda4-830f-4b73-939d-e17abc495c90 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019660 Sep 19 17:16:31.748060 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Sep 19 17:16:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:16:31.757878 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-42f4a15b-978a-45c4-abc1-23c1e991f711 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:31.773743 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-42f4a15b-978a-45c4-abc1-23c1e991f711 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019474 Sep 19 17:16:31.774295 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Sep 19 17:16:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:16:31.783979 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-8b696f6f-5099-4da1-9c31-c9a60c9b5f1e admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:31.789196 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.wsgi [None req-8b696f6f-5099-4da1-9c31-c9a60c9b5f1e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-8b696f6f-5099-4da1-9c31-c9a60c9b5f1e admin admin] Request method failure captured: Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Accept: application/json Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Accept-Encoding: gzip, deflate Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Connection: keep-alive Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Content-Length: 0 Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Host: 10.222.0.61 Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Openstack-Api-Version: compute 2.92 Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Openstack-System-Scope: None Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: User-Agent: python-novaclient Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Auth-Token: gAAAAABjKKPvTtm-7HuI1cvfdxX8LzgXYR-rTNwcK_Gp3fCLFNUElkcQVkNQfZpRUi6OoKYavnoC06z1_HKMWChJ1gLuxZ0FrYqzUap95Bl5AeTl0Z-CkZ_1Js8xqQFJ--92pkb-qy3VF4aIpfiXcwLBpggT91yPHla9bRWSNGoWREm6-NFULpQ Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Domain-Id: None Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Domain-Name: None Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Identity-Status: Confirmed Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Is-Admin-Project: True Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Domain-Id: default Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Domain-Name: Default Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Name: admin Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Role: reader,member,admin Sep 19 17:16:31.791038 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Roles: reader,member,admin Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4c5c785487de49b6a9006f75495cc370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}] Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Tenant: admin Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Tenant-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Tenant-Name: admin Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User: admin Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Domain-Id: default Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Domain-Name: Default Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Id: 6b446081736e459d86a67b4fd3fa5f03 Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Name: admin Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: method: > Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: exception: Flavor 84 could not be found. Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: action_args: {'id': '84'} Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:16:31.792557 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:31.793501 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:31.795624 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-8b696f6f-5099-4da1-9c31-c9a60c9b5f1e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:16:31.796858 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-8b696f6f-5099-4da1-9c31-c9a60c9b5f1e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012186 Sep 19 17:16:31.796858 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Sep 19 17:16:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 19 17:16:33.016189 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-42f4a15b-978a-45c4-abc1-23c1e991f711 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:33.017209 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-42f4a15b-978a-45c4-abc1-23c1e991f711 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Sep 19 17:16:33.017606 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:16:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:33.542835 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-eeb300a4-4561-4485-ba01-9f533112047c admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:33.549303 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.wsgi [None req-eeb300a4-4561-4485-ba01-9f533112047c admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-eeb300a4-4561-4485-ba01-9f533112047c admin admin] Request method failure captured: Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Accept: application/json Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Accept-Encoding: gzip, deflate Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Connection: keep-alive Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Content-Length: 0 Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Host: 10.222.0.61 Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Openstack-Api-Version: compute 2.92 Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Openstack-System-Scope: None Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: User-Agent: python-novaclient Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Auth-Token: gAAAAABjKKPwEN5iP2iaw0YJu8axUOrjTVlsiJ7ymmGom0g7x12eoE2fz9JaGWqGSeIIoORzN6b2MUFHgawjBMYMddAJANegZ_1MiXGyU1YGxEophBfl1r3z5_n1O9OAo6166bMnXUSrvoUMv1G-GUmKqWzzCDUtQclzBD5qenSKoYyH7IDK5vM Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Domain-Id: None Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Domain-Name: None Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Identity-Status: Confirmed Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Is-Admin-Project: True Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Domain-Id: default Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Domain-Name: Default Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Project-Name: admin Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Role: reader,member,admin Sep 19 17:16:33.550918 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Roles: reader,member,admin Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4c5c785487de49b6a9006f75495cc370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}] Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Tenant: admin Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Tenant-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-Tenant-Name: admin Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User: admin Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Domain-Id: default Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Domain-Name: Default Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Id: 6b446081736e459d86a67b4fd3fa5f03 Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: X-User-Name: admin Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: method: > Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: exception: Flavor 451 could not be found. Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: action_args: {'id': '451'} Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:16:33.552477 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:33.553339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: ERROR nova.api.openstack.wsgi Sep 19 17:16:33.554389 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-eeb300a4-4561-4485-ba01-9f533112047c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:16:33.555509 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-eeb300a4-4561-4485-ba01-9f533112047c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.397598 Sep 19 17:16:33.555509 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Sep 19 17:16:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:33.562792 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-43c66e08-d92b-42ce-8499-5c1237ca0f1c admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:33.577740 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-43c66e08-d92b-42ce-8499-5c1237ca0f1c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019212 Sep 19 17:16:33.578277 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Sep 19 17:16:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:16:33.587859 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:33.603825 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019479 Sep 19 17:16:33.604503 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Sep 19 17:16:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:16:33.615191 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-6adb1fb7-80c2-47ba-8b52-759abd1caed4 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:33.619779 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.wsgi [None req-6adb1fb7-80c2-47ba-8b52-759abd1caed4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-6adb1fb7-80c2-47ba-8b52-759abd1caed4 admin admin] Request method failure captured: Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Accept: application/json Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Accept-Encoding: gzip, deflate Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Connection: keep-alive Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Content-Length: 0 Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Host: 10.222.0.61 Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Openstack-Api-Version: compute 2.92 Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Openstack-System-Scope: None Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: User-Agent: python-novaclient Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Auth-Token: gAAAAABjKKPwEN5iP2iaw0YJu8axUOrjTVlsiJ7ymmGom0g7x12eoE2fz9JaGWqGSeIIoORzN6b2MUFHgawjBMYMddAJANegZ_1MiXGyU1YGxEophBfl1r3z5_n1O9OAo6166bMnXUSrvoUMv1G-GUmKqWzzCDUtQclzBD5qenSKoYyH7IDK5vM Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Domain-Id: None Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Domain-Name: None Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Identity-Status: Confirmed Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Is-Admin-Project: True Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Domain-Id: default Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Domain-Name: Default Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Project-Name: admin Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Role: reader,member,admin Sep 19 17:16:33.621282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Roles: reader,member,admin Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4c5c785487de49b6a9006f75495cc370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c5c785487de49b6a9006f75495cc370"}]}] Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Tenant: admin Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Tenant-Id: 4c5c785487de49b6a9006f75495cc370 Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-Tenant-Name: admin Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User: admin Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Domain-Id: default Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Domain-Name: Default Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Id: 6b446081736e459d86a67b4fd3fa5f03 Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: X-User-Name: admin Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: method: > Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: exception: Flavor 451 could not be found. Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: action_args: {'id': '451'} Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:16:33.622828 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:33.623867 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: ERROR nova.api.openstack.wsgi Sep 19 17:16:33.625162 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-6adb1fb7-80c2-47ba-8b52-759abd1caed4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:16:33.626240 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-6adb1fb7-80c2-47ba-8b52-759abd1caed4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011731 Sep 19 17:16:33.626240 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Sep 19 17:16:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:34.855401 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:34.856962 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 19 17:16:34.857362 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:16:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:35.385349 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-deb2edb7-918a-4bad-9662-404f054a5fa8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:35.476368 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-deb2edb7-918a-4bad-9662-404f054a5fa8 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.479025 Sep 19 17:16:35.476998 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Sep 19 17:16:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:16:36.696022 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:36.697039 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 19 17:16:36.697469 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:16:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:37.227184 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-b0e70130-4e94-4b2d-8a2c-ca12715a19bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:37.311082 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-b0e70130-4e94-4b2d-8a2c-ca12715a19bb admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.472903 Sep 19 17:16:37.311558 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Sep 19 17:16:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:16:38.544277 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:38.545401 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Sep 19 17:16:38.545813 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:16:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:39.078246 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-150bfd99-9c3b-4a01-bc87-608917d93828 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:39.162309 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-150bfd99-9c3b-4a01-bc87-608917d93828 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.476528 Sep 19 17:16:39.162854 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Sep 19 17:16:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:16:40.398226 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:40.399262 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 19 17:16:40.399650 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:16:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:40.924914 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-e7d5fbc8-58eb-49b7-8a32-1ed30e364443 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:16:40.996738 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-e7d5fbc8-58eb-49b7-8a32-1ed30e364443 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.460519 Sep 19 17:16:40.997312 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Sep 19 17:16:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:16:42.241122 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:42.242137 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 19 17:16:42.242865 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:16:42.773282 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-96e0c941-579a-4b97-a532-f32a47833710 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:16:42.793991 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-96e0c941-579a-4b97-a532-f32a47833710 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.411337 Sep 19 17:16:42.794538 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Mon Sep 19 17:16:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:17:40.143944 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:17:40.145020 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-cb69cf5a-5691-46e7-9075-a7e877f13730 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Sep 19 17:17:40.145431 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 931 bytes} [Mon Sep 19 17:17:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:17:40.156629 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:40.551906 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-43ba6725-4750-4683-aac5-85526d69abd7 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:17:40.574933 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-43ba6725-4750-4683-aac5-85526d69abd7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.422776 Sep 19 17:17:40.575482 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1292 bytes} [Mon Sep 19 17:17:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:17:40.596082 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writing DB stats nova_api:SELECT=14 {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:40.599825 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-2abeef45-a20a-4ff1-b26d-51a41c34e180 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:17:40.607128 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-2abeef45-a20a-4ff1-b26d-51a41c34e180 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012457 Sep 19 17:17:40.607685 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1283 bytes} [Mon Sep 19 17:17:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:17:40.620460 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-963c06f5-2917-478d-bbaf-d0d40b22244c admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:17:40.627909 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-963c06f5-2917-478d-bbaf-d0d40b22244c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011814 Sep 19 17:17:40.628458 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1286 bytes} [Mon Sep 19 17:17:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:17:40.640819 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-0fe16d55-3a40-45d9-95f5-a980bde44e52 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:17:40.648601 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-0fe16d55-3a40-45d9-95f5-a980bde44e52 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011422 Sep 19 17:17:40.649118 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1286 bytes} [Mon Sep 19 17:17:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:17:40.661335 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-20d70a5d-d14a-4b72-8d2d-ccfc4f9be158 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:17:40.669350 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-20d70a5d-d14a-4b72-8d2d-ccfc4f9be158 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011961 Sep 19 17:17:40.669899 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1283 bytes} [Mon Sep 19 17:17:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:21:12.438646 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-0fe16d55-3a40-45d9-95f5-a980bde44e52 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:21:12.439804 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-0fe16d55-3a40-45d9-95f5-a980bde44e52 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Sep 19 17:21:12.440208 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:21:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:21:12.584197 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writing DB stats nova_api:SELECT=6 {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:21:12.725899 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-ce0f87a1-5db3-4c97-ba64-623e19b313e8 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:21:12.730591 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-ce0f87a1-5db3-4c97-ba64-623e19b313e8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:21:12.731098 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-ce0f87a1-5db3-4c97-ba64-623e19b313e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:21:12.731536 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-ce0f87a1-5db3-4c97-ba64-623e19b313e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:21:12.732296 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-ce0f87a1-5db3-4c97-ba64-623e19b313e8 admin admin] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:21:12.732778 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-ce0f87a1-5db3-4c97-ba64-623e19b313e8 admin admin] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:21:12.733206 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-ce0f87a1-5db3-4c97-ba64-623e19b313e8 admin admin] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:21:12.765142 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-ce0f87a1-5db3-4c97-ba64-623e19b313e8 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.182189 Sep 19 17:21:12.765709 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Sep 19 17:21:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:21:13.861183 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-0fe16d55-3a40-45d9-95f5-a980bde44e52 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:21:13.862199 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-0fe16d55-3a40-45d9-95f5-a980bde44e52 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 19 17:21:13.862602 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:21:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:21:14.056856 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-7680fcb7-894d-4d4d-9a56-5f2736c6ba6c admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:21:14.060302 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-7680fcb7-894d-4d4d-9a56-5f2736c6ba6c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:21:14.060925 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-7680fcb7-894d-4d4d-9a56-5f2736c6ba6c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:21:14.061359 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-7680fcb7-894d-4d4d-9a56-5f2736c6ba6c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:21:14.062646 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-7680fcb7-894d-4d4d-9a56-5f2736c6ba6c admin admin] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:21:14.063123 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-7680fcb7-894d-4d4d-9a56-5f2736c6ba6c admin admin] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:21:14.063548 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-7680fcb7-894d-4d4d-9a56-5f2736c6ba6c admin admin] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:21:14.084126 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-7680fcb7-894d-4d4d-9a56-5f2736c6ba6c admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.081108 Sep 19 17:21:14.084683 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Sep 19 17:21:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:21:25.742651 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-0fe16d55-3a40-45d9-95f5-a980bde44e52 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:21:25.743675 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-0fe16d55-3a40-45d9-95f5-a980bde44e52 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 19 17:21:25.744105 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:21:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:21:25.891451 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writing DB stats nova_cell0:SELECT=4 {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:21:25.892209 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writing DB stats nova_cell1:SELECT=4 {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:21:25.892808 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG dbcounter [-] [106097] Writing DB stats nova_api:SELECT=8 {{(pid=106097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:21:25.945496 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-5eee192a-0ac5-4b54-b6f6-56d9b4d7e0c8 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:21:25.949164 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-5eee192a-0ac5-4b54-b6f6-56d9b4d7e0c8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:21:25.949633 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-5eee192a-0ac5-4b54-b6f6-56d9b4d7e0c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:21:25.950063 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-5eee192a-0ac5-4b54-b6f6-56d9b4d7e0c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:21:25.950805 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-5eee192a-0ac5-4b54-b6f6-56d9b4d7e0c8 admin admin] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:21:25.951251 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-5eee192a-0ac5-4b54-b6f6-56d9b4d7e0c8 admin admin] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:21:25.951665 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-5eee192a-0ac5-4b54-b6f6-56d9b4d7e0c8 admin admin] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:21:25.977902 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-5eee192a-0ac5-4b54-b6f6-56d9b4d7e0c8 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.091681 Sep 19 17:21:25.978464 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Sep 19 17:21:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:21:27.089912 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG nova.api.openstack.wsgi [None req-0fe16d55-3a40-45d9-95f5-a980bde44e52 admin admin] Calling method '>' {{(pid=106096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:21:27.090932 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: INFO nova.api.openstack.requestlog [None req-0fe16d55-3a40-45d9-95f5-a980bde44e52 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 19 17:21:27.091339 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: [pid: 106096|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Sep 19 17:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:21:27.290930 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG nova.api.openstack.wsgi [None req-9d589a04-b5cf-4c5d-a715-63cee8ba2b84 admin admin] Calling method '>' {{(pid=106097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:21:27.294402 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-9d589a04-b5cf-4c5d-a715-63cee8ba2b84 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:21:27.294899 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-9d589a04-b5cf-4c5d-a715-63cee8ba2b84 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:21:27.295335 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-9d589a04-b5cf-4c5d-a715-63cee8ba2b84 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:21:27.296179 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-9d589a04-b5cf-4c5d-a715-63cee8ba2b84 admin admin] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:21:27.297174 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-9d589a04-b5cf-4c5d-a715-63cee8ba2b84 admin admin] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:21:27.297605 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: DEBUG oslo_concurrency.lockutils [None req-9d589a04-b5cf-4c5d-a715-63cee8ba2b84 admin admin] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:21:27.319551 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: INFO nova.api.openstack.requestlog [None req-9d589a04-b5cf-4c5d-a715-63cee8ba2b84 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.083682 Sep 19 17:21:27.320160 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: [pid: 106097|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Sep 19 17:21:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:22:26.131631 dv-cinder-848013-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 19 17:22:26.135167 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: Mon Sep 19 17:22:26 2022 - graceful shutdown triggered... Sep 19 17:22:26.135787 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: Gracefully killing worker 1 (pid: 106096)... Sep 19 17:22:26.136177 dv-cinder-848013-2-iscsi devstack@n-api.service[106097]: Gracefully killing worker 2 (pid: 106097)... Sep 19 17:22:26.261109 dv-cinder-848013-2-iscsi devstack@n-api.service[106096]: DEBUG dbcounter [-] [106096] Writing DB stats nova_api:SELECT=4 {{(pid=106096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:22:27.132314 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: worker 1 buried after 1 seconds Sep 19 17:22:27.132566 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: worker 2 buried after 1 seconds Sep 19 17:22:27.132566 dv-cinder-848013-2-iscsi devstack@n-api.service[106095]: goodbye to uWSGI. Sep 19 17:22:27.133972 dv-cinder-848013-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 19 17:22:27.134522 dv-cinder-848013-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 19 17:22:27.137406 dv-cinder-848013-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 17:22:27.148653 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 17:22:27.150890 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 17:22:27 2022] *** Sep 19 17:22:27.150890 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 17:22:27.150890 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 17:22:27.150890 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: nodename: dv-cinder-848013-2-iscsi Sep 19 17:22:27.150890 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: machine: x86_64 Sep 19 17:22:27.150890 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: clock source: unix Sep 19 17:22:27.150890 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: pcre jit disabled Sep 19 17:22:27.150890 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: detected number of CPU cores: 4 Sep 19 17:22:27.150890 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: current working directory: / Sep 19 17:22:27.150890 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: detected binary path: /usr/bin/uwsgi-core Sep 19 17:22:27.151685 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: your processes number limit is 47680 Sep 19 17:22:27.151685 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: your memory page size is 4096 bytes Sep 19 17:22:27.151685 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: detected max file descriptor number: 2048 Sep 19 17:22:27.151685 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: lock engine: pthread robust mutexes Sep 19 17:22:27.151685 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: thunder lock: enabled Sep 19 17:22:27.151685 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 17:22:27.151685 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 17:22:27.192581 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: Python main interpreter initialized at 0x5573bbcaa9c0 Sep 19 17:22:27.192581 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: python threads support enabled Sep 19 17:22:27.192581 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: your server socket listen backlog is limited to 100 connections Sep 19 17:22:27.192581 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: your mercy for graceful operations on workers is 90 seconds Sep 19 17:22:27.193055 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 17:22:27.193055 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: *** Operational MODE: preforking *** Sep 19 17:22:27.193334 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: *** uWSGI is running in multiple interpreter mode *** Sep 19 17:22:27.193334 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: spawned uWSGI master process (pid: 121121) Sep 19 17:22:27.193568 dv-cinder-848013-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 17:22:27.194168 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: spawned uWSGI worker 1 (pid: 121134, cores: 1) Sep 19 17:22:27.194677 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: spawned uWSGI worker 2 (pid: 121135, cores: 1) Sep 19 17:22:27.194942 dv-cinder-848013-2-iscsi devstack@n-api.service[121121]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 17:22:27.859220 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 17:22:27.861358 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 17:22:29.029076 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 17:22:29.029076 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: from cryptography.utils import int_from_bytes Sep 19 17:22:29.029757 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 17:22:29.029757 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: from cryptography.utils import int_from_bytes Sep 19 17:22:29.042571 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 17:22:29.042571 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: from cryptography.utils import int_from_bytes Sep 19 17:22:29.043160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 17:22:29.043160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: from cryptography.utils import int_from_bytes Sep 19 17:22:31.669607 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 17:22:31.670271 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 17:22:31.670271 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 17:22:31.670700 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 17:22:31.671010 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 17:22:31.671128 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 17:22:31.671562 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 17:22:31.671679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 17:22:31.672011 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 17:22:31.672147 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 17:22:31.672643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.672751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.673191 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.673304 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.673729 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.673868 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.674280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.674398 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.674833 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.674936 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.675358 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.675491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.675992 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.676111 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.676544 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.676641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.677103 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.677206 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.677544 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.677639 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.678077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.678224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.678862 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848013-2-iscsi {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.679018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848013-2-iscsi {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.679431 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.679548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.680064 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.680213 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.680730 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.680850 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.681142 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.681248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.681720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.681828 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.682284 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.682405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.682846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.682948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.683736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.683870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.684421 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.684517 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.688736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.688891 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689132 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689202 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689429 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689429 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689706 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689706 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689879 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.689879 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.690014 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.690089 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.690159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.692214 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848013-2-iscsi {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.692342 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848013-2-iscsi {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.692428 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.692510 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.692510 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.692653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.692653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.692787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.692855 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.692934 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.693387 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.693503 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.693918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.694010 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.694476 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.694576 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.695049 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.695209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.695589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.695783 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.696248 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.696359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.696801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.696900 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.697354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.697445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.697907 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.698005 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.698426 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.698525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.698960 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.699052 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.699491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.699596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.700080 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.705841 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.705969 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.706062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.706062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.706243 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.706243 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.706412 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.706412 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.706575 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.706663 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.706753 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.706836 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.706924 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.707054 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.707150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.707150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.707313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.707313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.707479 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.707569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.707658 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.707658 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.707907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.708008 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.708093 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.708182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.708274 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.708356 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.708494 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.708494 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.708657 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.708928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.709058 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.709453 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.709546 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.709981 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.710073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.710510 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.710619 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.711177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.711286 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.711677 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.711805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.712271 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.712377 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.712809 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.712901 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.713365 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.713522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.714058 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.714163 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.714492 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.714593 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.715026 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.715117 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.715610 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.715798 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.716193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.716290 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.716735 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.716828 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.717361 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.717467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.717959 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.718097 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.718494 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.718605 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.719025 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.719133 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.719555 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.719673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.720138 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.720237 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.720711 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.720817 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.721243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.721342 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.721677 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.721792 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.722197 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.722334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.722914 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.723026 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.723357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.723503 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.723903 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.724078 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.724432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.724529 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.724967 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.725081 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.725487 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.725581 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.726017 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.726126 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.726545 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.726655 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.727074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.727171 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.727601 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.727741 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.728161 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.728276 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.728692 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.728790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.729227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.729330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.729755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.729847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.730277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.730376 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.730802 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.730901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.731348 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.731447 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.731930 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.732037 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.732461 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.732558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.732994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.733099 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.733550 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.733742 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.734078 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.734179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.734628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.734760 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.735162 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.735259 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.735747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.735878 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.736260 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.736378 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.736786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.736929 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.737460 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.737565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.737852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.737967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.738383 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.738490 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.738910 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.739028 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.739460 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.739570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.740026 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.740141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.740577 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.740751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.741132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.741290 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.741681 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.742224 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.742485 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.742775 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.743322 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.743710 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.743908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.744420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.744649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.744957 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.745219 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.745492 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.745856 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.746026 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.746387 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.746570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.746919 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.747121 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.747447 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.747654 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.748066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.748368 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.748562 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.748911 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.749649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.749997 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.750177 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.750577 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.750731 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.751149 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.751248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.751743 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 17:22:31.751858 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.752287 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.752379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.752848 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.752942 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.753422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.753519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.753965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.754107 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.754508 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.754630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.755052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.755174 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.755592 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.755714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.756165 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.756270 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.756701 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.756828 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.757246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.757350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.757813 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.757928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.758369 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.758487 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.758949 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.759081 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.759493 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.759591 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.760066 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.760185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.760613 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.760719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.761152 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.761251 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.761700 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.761806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.762251 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.762353 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.762831 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.762937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.763372 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.763534 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.763965 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.764133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.764530 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.764688 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.765615 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.765732 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.766176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.766289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.766728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.766867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.767266 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.767372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.767832 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.767926 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.768374 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.768481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.768922 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.769019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.769464 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.769569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.769999 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.770110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.770544 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.770648 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.771087 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.771194 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.771627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.771768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.772194 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.772297 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.772729 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.772826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.773490 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.773612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.773813 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.773914 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.774608 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.774721 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.775154 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.775253 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.775720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.775839 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.776259 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.776350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.776810 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.776972 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.777353 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.777452 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.777899 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.777992 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.778521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.778628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.778979 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.779072 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.779520 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.779619 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.780093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.780189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.780676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.780767 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.781218 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.781309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.781765 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.781863 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.782300 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.782392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.782836 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.782942 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.783377 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.783479 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.783937 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.784048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.784491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.784607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.785028 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.785127 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.785565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.785656 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.786113 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.786226 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.786642 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.786737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.787171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.787273 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.787714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.787827 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.788348 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.788471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.788817 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.788910 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.789368 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.789461 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.789915 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.790006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.790443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.790543 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.790991 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.791089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.791516 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.791607 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.792073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.792167 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.793139 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.793234 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.793234 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.793390 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.793734 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.793825 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.794278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.794369 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.794818 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.794926 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.795353 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.795453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.795923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.796077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.796492 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.796612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.797048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.797163 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.797597 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.797691 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.798126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.798224 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.798690 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.798795 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.799248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.799340 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.799867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.799972 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.800413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.800503 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.800958 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.801088 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.801487 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.801592 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.802011 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.802103 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.802570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.802937 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.803070 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.803171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.803595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.803726 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.804160 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.804254 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.804787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.804893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.805156 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.805258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.805476 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.805597 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.805815 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.805940 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.806200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.806292 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.806439 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.806600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.806754 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.806957 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.807065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.807295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.807446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.807619 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.807741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.807973 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.808075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.808323 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.808499 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.808778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.808888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.809159 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.809280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.809491 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.809645 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.809818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.810001 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.810141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.810337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.810463 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.810678 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.810772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.811006 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.811098 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.811335 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.811431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.812175 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.812276 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.812503 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.812596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.812829 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.812928 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.813157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.813247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.813490 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.813590 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.813813 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.813904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.814130 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.814223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.814452 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.814562 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.814790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.814893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.815116 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.815227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.815441 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.815532 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.815778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.815884 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.816105 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.816220 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.816429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.816541 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.816748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.816848 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.817069 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.817174 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.817386 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.817523 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.817709 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.817842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.818038 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.818145 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.818356 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.818455 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.818682 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.818773 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.819001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.819110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.819335 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.819434 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.819654 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.819779 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.820010 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.820102 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.820326 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.820416 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.820640 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.820737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.821048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.821159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.821340 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.821624 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.821938 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.822075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.822289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.822423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.822630 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.822755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.822974 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.823248 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.823376 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.823584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.823762 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.823947 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.824069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.824257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.824373 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.824574 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.824697 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.824907 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.825077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.825232 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.825352 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.825563 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.825699 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.825886 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.826024 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.826208 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.826347 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.826586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.826743 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.826879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.827014 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.827176 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.828041 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.828174 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.828292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.828425 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.828567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.828684 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.828791 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.828924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.829058 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.829245 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.829392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.829579 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.829711 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.829899 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.830036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.830233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.830366 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.830548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.830673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.830867 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.831004 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.831181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.831352 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.831482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.831613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.831817 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.831948 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.832124 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.832254 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.832439 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.832569 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.832751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.833052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.833198 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.833324 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.833458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.833585 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.833820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.833958 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.834095 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.834212 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.834326 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.834435 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.834647 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.834786 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.835027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.835173 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.835290 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.835443 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.835582 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.835760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.835924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.836056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.836245 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.836349 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.836560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.836663 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.836876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.836981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.837195 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.837329 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.837534 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.837732 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.837896 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.838066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.838259 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.838411 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.838587 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.838740 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.838907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.839047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.839227 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.839328 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.839540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.839683 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.839889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.840199 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.840293 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.840547 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.840789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.840891 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.841130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.841229 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.841452 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.841544 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.841777 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.841878 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.842126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.842242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.842450 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.842550 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.842787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.842893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.843121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.843264 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.843440 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.843584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.843775 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.843885 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.844095 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.844248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.844411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.844541 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.844724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.844853 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.845037 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.845186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.845346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.845437 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.845657 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.845759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.845966 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.846059 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.846280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.846371 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.846588 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.846679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.846900 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.847008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.847208 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.847320 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.847517 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.847611 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.847860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.847953 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.848171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.848275 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.848492 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.848595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.848798 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.848898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.849130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.849231 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.849444 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.849538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.849751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.849844 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.850058 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.850192 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.850367 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.850511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.850719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.850865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.851034 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.851203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.851381 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.851559 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.851737 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.851971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.856053 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.856182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.856287 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.856373 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.856456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.856588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.856792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.856883 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.856974 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.857057 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.857188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.857296 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.857392 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.857477 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.857559 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.857640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.857729 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.857729 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.857901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.857991 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.858074 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.858162 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.858245 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.858341 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.858432 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.858676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.858770 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.858854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.858993 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.859091 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.859176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.859305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.859400 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.859496 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.859587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.859680 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.859793 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.859931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860109 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860293 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860377 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860541 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860713 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860804 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.860976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.861060 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.861149 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.861309 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.861395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.861485 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.861569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.861657 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.861747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.861843 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.861934 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.862017 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.862099 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.862187 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.862277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.862369 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.862454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.862536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.862655 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.862755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.862967 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.863066 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.863278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.863382 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.863594 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.863720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.863932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.864032 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.864249 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.864341 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.864561 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.864659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.864900 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.865016 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.865879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.866395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.866498 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.866584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.866677 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.866770 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.866854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.866854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.867013 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.867110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.867194 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.867337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.867432 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.867523 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.867606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.867736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.867883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.868035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.868128 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.868348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.868442 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.868681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.868785 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.868990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.869137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.869303 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.869435 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.869614 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.869708 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.869923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.870016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.870232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.870336 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.870585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.870676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.870895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.870986 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.871267 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.871381 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.871570 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.871673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.871919 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.872027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.872247 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.872349 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.872573 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.872709 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.872877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.872976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.873196 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.873296 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.873506 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.873613 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.873833 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.873944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.874696 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.874801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.875016 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.875108 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.875327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.875427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.875638 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.875785 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.875993 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.876099 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.876309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.876401 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.876624 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.876724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.876951 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.877042 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.877278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.877377 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.877606 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.877747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.877917 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.878017 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.878232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.878335 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.878546 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.878645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.878854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.878986 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.879159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.879301 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.879505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.879607 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.879847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.879955 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.880166 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.880268 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.880483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.880580 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.880801 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.880893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.881117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.881221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.881431 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.881522 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.881747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.881841 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.882063 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.882164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.882376 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.882522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.882708 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.882810 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.883024 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.883117 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.883336 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.883436 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.883651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.883773 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.883986 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.884085 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.884304 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.884402 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.884613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.884703 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.885062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.885175 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.885376 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.885467 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.885691 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.885793 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.885999 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.886098 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.886313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.886438 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.886630 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.886731 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.886953 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.887053 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.887274 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.887373 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.887585 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.887685 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.888040 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.888133 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.891117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.891402 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.891498 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.891583 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.891657 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.891767 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.891841 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.891926 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.892000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.892093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.892179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.892270 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.892363 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.892454 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.892621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.892621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.892774 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.892959 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893358 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893427 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893496 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893496 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893630 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893630 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893757 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.893936 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.894034 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.894114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.894312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.894411 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.894627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.894720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.894960 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.895068 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.895282 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.895381 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.895613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.895733 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.895971 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.896105 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.896293 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.896396 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.896745 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.896927 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.897027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.897109 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.897338 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.897488 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.897594 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.897720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.897913 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.898006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.898225 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.898316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.898555 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.898671 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.898882 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.899043 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.899204 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.899578 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.899807 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.899920 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.900315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.900432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.900550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.900663 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.900868 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.900969 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.901198 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.901290 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.901528 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.901637 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.901839 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.901970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.902151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.902278 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.902465 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.902572 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.902774 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.902873 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.903084 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.903176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.903411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.903504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.903766 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.903880 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.904088 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.904180 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.904403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.904495 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.904714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.904818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.905068 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.905159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.905427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.905530 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.905747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.905841 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.906086 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.906186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.906405 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.906498 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.906730 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.906827 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.907055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.907152 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.907382 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.907473 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.907730 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.907883 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.908111 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.908252 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.908432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.908558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.908743 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.908867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.909052 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.909194 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.909361 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.909496 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.909675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.909797 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.910010 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.910150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.910332 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.910453 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.910665 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.910807 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.911000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.911142 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.911316 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.911459 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.911650 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.911798 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.912010 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.912336 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.912652 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.912902 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.913042 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.913252 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.913362 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.913585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.913780 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.913883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.914114 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.914240 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.914507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.914612 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.914792 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.914886 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.915112 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.915214 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.915432 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.915573 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.915775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.915867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.916078 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.916181 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.916388 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.916481 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.916705 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.916806 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.917017 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.917119 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.917335 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.917426 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.917649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.917747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.917959 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.918061 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.918270 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.918374 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.918578 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.918676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.918917 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.919016 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.919230 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.919362 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.919544 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.919683 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.919882 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.920026 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.920196 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.920298 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.920523 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.920623 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.920846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.921444 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.921682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.921783 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.922003 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.922105 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.922324 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.922430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.922645 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.922737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.922964 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.923071 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.923278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.923377 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.923610 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.923763 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.923958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.928927 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.929062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.929167 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.929167 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.929325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.929478 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.929631 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.929767 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.929858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.929945 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.930018 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.930151 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.930251 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.930251 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.930480 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.930574 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.930660 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.930758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.930844 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.930928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.931024 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.931117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.931202 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.931300 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.931385 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.931470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.931560 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.931645 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.931749 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.931850 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.931937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932018 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932099 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932172 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932257 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932341 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932422 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932494 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932564 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932706 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932893 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.932978 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.933062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.933145 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.933237 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.933372 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.933461 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.933553 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.933639 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.933719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.933813 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.933898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.933984 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.934067 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.934159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.934250 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.934347 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.934347 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.934503 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.934637 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.934732 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.934826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.934912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.934995 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.935078 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.935149 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.935242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.935337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.935422 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.935550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.935682 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.935900 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.936024 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.936220 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.936319 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.936537 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.937189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.937395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.937501 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.937729 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.937990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.938091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.938313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.938408 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.938654 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.938755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.938987 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.939080 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.939322 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.939414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.939643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.939880 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.939993 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.940264 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.940358 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.940678 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.940816 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.941006 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.941107 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.941325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.941427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.941641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.941743 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.941953 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.942046 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.942284 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.942384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.942598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.942693 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.942908 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.943000 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.943227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.943318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.943546 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.943646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.943884 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.944111 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.944205 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.944472 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.944582 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.944796 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.944892 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.945132 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.945233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.945504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.945599 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.945852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.946055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.946156 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.946420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.946528 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.946753 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.946846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.947090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.947182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.947413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.947516 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.947765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.947890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.948080 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.948181 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.948395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.948500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.948713 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.948814 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.949028 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.949127 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.949335 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.949429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.949650 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.949789 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.949959 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.950063 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.950291 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.950388 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.950635 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.950764 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.950951 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.951056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.951262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.951364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.951580 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.951685 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.951928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.952041 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.952263 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.952362 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.952572 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.952666 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.952882 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.952980 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.953201 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.953305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.953517 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.953610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.953864 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.953970 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.954182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.954282 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.954497 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.954590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.954811 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.954915 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.955193 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.955311 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.955585 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.955720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.955855 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.956014 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.956168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.956334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.956477 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.956658 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.956802 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.957031 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.957126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.957354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.957456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.957670 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.957829 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.958005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.958109 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.958322 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.958462 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.958636 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.958745 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.958964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.959216 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.959318 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.959557 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.959659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.959912 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.959996 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.960246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.960346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.960581 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.960697 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.960893 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.961023 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.961205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.961505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.961633 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.961830 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.961923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.962144 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.962237 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.962459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.962554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.962771 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.962872 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.963084 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.963222 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.963402 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.963506 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.963737 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.963835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.964054 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.964160 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.964368 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.964471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.964679 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.964772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.964989 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.965100 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.965301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.965403 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.965613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.965714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.965924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.966017 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.966233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.966327 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.966547 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.966639 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.966863 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.966956 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.967177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.967280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.967493 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.967577 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.967850 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.967949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.968170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.968272 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.968484 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.968583 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.968805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.968908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.969123 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.969223 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.969440 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.969556 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.969764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.969871 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.970101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.970199 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.970424 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.970528 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.970736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.970839 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.971121 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.971213 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.971443 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.971536 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.971790 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.971902 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.972119 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.972220 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.972432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.972523 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.972756 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.972898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.973072 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.973165 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.973395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.973515 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.973719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.973865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.974064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.974258 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.974402 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.974652 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.974761 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.974976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.975082 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.975309 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.975411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.975668 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.975811 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.975994 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.976102 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.976302 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.976402 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.976617 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.976759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.976939 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.977033 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.977252 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.977346 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.977559 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.977662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.977866 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.977960 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.978179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.978283 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.978485 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.978629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.978794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.978900 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.979100 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.979204 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.979407 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.979501 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.979737 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.979856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.980048 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.980157 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.980366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.980501 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.980665 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.980758 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.980972 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.981079 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.981281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.981374 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.981588 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.981682 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.981901 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.981996 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.982209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.982354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.982515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.982622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.982820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.982945 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.983171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.983330 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.984076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.984179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.987928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.988051 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.988159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.988247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.988338 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.988431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.988532 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.988625 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.988625 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.988848 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.988944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.989043 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.989191 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.989329 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.989432 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.989519 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.989609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.989708 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.989800 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.989886 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.990013 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.990106 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.990230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.990369 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.990369 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.990537 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.990617 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.990740 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.990883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.990980 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.991065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.991137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.991228 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.991312 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.991398 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.991472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.991546 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.991630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.991744 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.991831 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.991933 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.992076 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.992166 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.992265 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.992351 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.992441 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.992535 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.992627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.992712 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.992803 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.992888 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.992986 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.993119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.993213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.993309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.993395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.993473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.993567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.993652 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.993732 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.993930 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.994038 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.994247 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.994355 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.994569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.994671 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.994884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.994987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.995200 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.995338 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.995519 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.995612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.995865 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.995974 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.996200 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.996301 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.996533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.996633 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.996846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.996944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.997168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.997271 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.997488 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.997581 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.997807 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.997965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.998130 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.998225 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.998453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.998547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.998791 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.998898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.999179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:31.999788 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.000338 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.000491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.000491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.000649 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.000753 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 17:22:32.000891 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.001180 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.001505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.001865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.002205 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.002530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.002852 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.003167 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 17:22:32.003421 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 17:22:32.063677 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO dbcounter [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Registered counter for database nova_api Sep 19 17:22:32.068576 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO dbcounter [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Registered counter for database nova_api Sep 19 17:22:32.084225 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_db.sqlalchemy.engines [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:22:32.089223 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_db.sqlalchemy.engines [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:22:32.090951 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writer thread running {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:22:32.096034 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writer thread running {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:22:32.148367 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.context [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb886613-25c5-4d71-85c4-935a7fe74cbe(cell1) {{(pid=121135) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 17:22:32.152652 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:22:32.153146 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:22:32.154759 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:22:32.155554 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:22:32.155785 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.context [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb886613-25c5-4d71-85c4-935a7fe74cbe(cell1) {{(pid=121134) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 17:22:32.156031 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:22:32.158143 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:22:32.159953 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:22:32.160229 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO dbcounter [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Registered counter for database nova_cell0 Sep 19 17:22:32.160431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:22:32.162035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:22:32.162851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:22:32.163309 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:22:32.164478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO dbcounter [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Registered counter for database nova_cell1 Sep 19 17:22:32.165482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:22:32.167520 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO dbcounter [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Registered counter for database nova_cell0 Sep 19 17:22:32.172998 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO dbcounter [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Registered counter for database nova_cell1 Sep 19 17:22:32.175015 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_db.sqlalchemy.engines [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:22:32.176520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_db.sqlalchemy.engines [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:22:32.181962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_db.sqlalchemy.engines [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:22:32.188347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writer thread running {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:22:32.189342 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_db.sqlalchemy.engines [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:22:32.191341 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writer thread running {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:22:32.333047 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writer thread running {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:22:32.343976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO dbcounter [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Registered counter for database nova_cell0 Sep 19 17:22:32.349565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writer thread running {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:22:32.351642 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_db.sqlalchemy.engines [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:22:32.356422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writer thread running {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:22:32.363806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO dbcounter [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Registered counter for database nova_cell0 Sep 19 17:22:32.369511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_db.sqlalchemy.engines [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 17:22:32.376093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writer thread running {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 17:22:32.688669 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: WARNING keystonemiddleware.auth_token [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 17:22:32.697281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: WARNING keystonemiddleware.auth_token [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 17:22:32.702998 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: WARNING keystonemiddleware.auth_token [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 17:22:32.710820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: WARNING keystonemiddleware.auth_token [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 17:22:33.046775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: WARNING keystonemiddleware.auth_token [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 17:22:33.052853 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: WARNING keystonemiddleware.auth_token [None req-ee5f70c9-356a-4161-8133-c693d0cc49d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 17:22:33.058176 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573bbcaa9c0 pid: 121135 (default app) Sep 19 17:22:33.062327 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: WARNING keystonemiddleware.auth_token [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 17:22:33.068480 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: WARNING keystonemiddleware.auth_token [None req-cb17722c-bbc6-4c02-9862-6555025a3cbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 17:22:33.073842 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573bbcaa9c0 pid: 121134 (default app) Sep 19 17:23:15.647332 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:15.649095 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:15.650257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:15.651652 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:16.124707 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a6e7adf-f9a7-41f2-b7e6-67ada9389060 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] Calling method '.version_select at 0x7fd4d6fa7160>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:16.706406 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2a6e7adf-f9a7-41f2-b7e6-67ada9389060 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8fecdf77-023e-4e47-8da2-bad2873b0824" status: 200 len: 350 microversion: 2.1 time: 1.071651 Sep 19 17:23:16.711963 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1/1] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:23:15 2022] GET /compute/v2.1/os-volumes/8fecdf77-023e-4e47-8da2-bad2873b0824 => generated 350 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:23:20.162560 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-afedd763-2b33-4390-99b5-686adf17898c tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] Calling method '.version_select at 0x7fd4d6feaaf0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:20.194008 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:20.195133 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:20.196281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:20.197823 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:21.078519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-afedd763-2b33-4390-99b5-686adf17898c tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8c3af2ce-b01a-4f73-8ac7-350d95090f32" status: 200 len: 351 microversion: 2.1 time: 1.321877 Sep 19 17:23:21.079919 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1/2] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:23:19 2022] GET /compute/v2.1/os-volumes/8c3af2ce-b01a-4f73-8ac7-350d95090f32 => generated 351 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:23:21.314957 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cbcb0cc0-5579-468d-b5bb-4e0afc94bb4d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Action: 'create', calling method: .version_select at 0x7fd4d6e711f0>, body: {"keypair": {"name": "tempest-keypair-2104432587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnWkcwAXQRdBgMuV3Hd6QCLd35mwmYu3c6Nv95Tz/y3AIEI6b+FAKmeHVpFxfOZPKo32AuqdcAuHWcgA/ndAENnvVv6paFQ/3GQZwWPs0bnmmjzPM9gMmOiGMUDKnWaCA=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:21.417666 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-cbcb0cc0-5579-468d-b5bb-4e0afc94bb4d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Getting quotas for project 1f148193008640639adb751706133b25. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:23:21.426640 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-cbcb0cc0-5579-468d-b5bb-4e0afc94bb4d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Getting quotas for user 5c1fb1574d854a14bde2333da340d6a4 and project 1f148193008640639adb751706133b25. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:23:21.583440 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cbcb0cc0-5579-468d-b5bb-4e0afc94bb4d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.399415 Sep 19 17:23:21.584996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2/3] 10.222.0.61 () {62 vars in 1200 bytes} [Mon Sep 19 17:23:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 403 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 17:23:22.037768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-387893696", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "networks": [{"uuid": "9250236b-0273-43f2-a175-bd8e8ae1caee"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:22.261055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] validate_networks() for [('9250236b-0273-43f2-a175-bd8e8ae1caee', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:23:23.828573 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:23:23.834842 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:23:23.834842 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:23:23.834842 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:23:23.834842 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:23:23.857233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:23.857746 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:23.858222 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:23.859028 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:23.859514 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:23.860475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:23.945916 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Getting quotas for project 1bab2edcfa684d8a8befcb705fe3990e. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:23:23.965582 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Getting quotas for user 90d3b420b0f64c848c49b8149518e55e and project 1bab2edcfa684d8a8befcb705fe3990e. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:23:23.996199 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:23:24.008711 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:23:24.279874 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3b663b70-4dd0-4b92-9c88-5bc7535982b4 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.334974 Sep 19 17:23:24.280879 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2/4] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:23:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:23:24.295479 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3ec2c297-1cd9-4fde-847a-41bf59b5b421 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:24.299908 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3ec2c297-1cd9-4fde-847a-41bf59b5b421 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:24.565655 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3ec2c297-1cd9-4fde-847a-41bf59b5b421 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:24.599488 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3ec2c297-1cd9-4fde-847a-41bf59b5b421 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1214 microversion: 2.1 time: 0.309557 Sep 19 17:23:24.619996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3/5] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:24 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1214 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:24.926484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1960046879", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:25.055522 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] validate_networks() for [('fecf8741-4aac-48fd-b6b2-d491a4c0d8d5', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:23:25.629585 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-82b0753f-2931-4d42-adb0-0a58e713c191 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:25.636301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-82b0753f-2931-4d42-adb0-0a58e713c191 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:25.790448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-82b0753f-2931-4d42-adb0-0a58e713c191 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:25.810105 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-82b0753f-2931-4d42-adb0-0a58e713c191 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1214 microversion: 2.1 time: 0.186684 Sep 19 17:23:25.811281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 4/6] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:25 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:23:26.217791 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:23:26.221639 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:23:26.221639 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:23:26.221639 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:23:26.221639 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:23:26.244211 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:26.244709 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:26.245149 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:26.245878 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:26.246334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:26.246764 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:26.283134 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Getting quotas for project 4118102ca29c4b0fa344b21b9c9f1e85. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:23:26.288484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Getting quotas for user 4f460a4884d1486484a683f440459b6e and project 4118102ca29c4b0fa344b21b9c9f1e85. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:23:26.302924 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:23:26.305282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:23:26.476229 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dce8cf04-60ab-474f-8e2f-60d195f9b16c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.783286 Sep 19 17:23:26.476919 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3/7] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:23:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:23:26.491054 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-964f3487-a05a-4f79-b893-aee831d0a6b8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:26.491685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-964f3487-a05a-4f79-b893-aee831d0a6b8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:26.636112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-964f3487-a05a-4f79-b893-aee831d0a6b8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:26.657162 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-964f3487-a05a-4f79-b893-aee831d0a6b8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1222 microversion: 2.1 time: 0.170754 Sep 19 17:23:26.680143 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 5/8] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:26 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:26.841359 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7564dba1-aaff-4694-a70d-f83fd0c74bad tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:26.842729 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7564dba1-aaff-4694-a70d-f83fd0c74bad tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:26.974626 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-245772454", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4b55d20-22b3-42fd-86ee-53a53a1c48eb"}], "security_groups": [{"name": "tempest-securitygroup--722468174"}], "key_name": "tempest-keypair-2104432587", "user_data": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:27.102797 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7564dba1-aaff-4694-a70d-f83fd0c74bad tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:27.165036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7564dba1-aaff-4694-a70d-f83fd0c74bad tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1214 microversion: 2.1 time: 0.324900 Sep 19 17:23:27.170696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4/9] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:26 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1214 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:27.188773 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-411361119", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:27.235044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] validate_networks() for [('a4b55d20-22b3-42fd-86ee-53a53a1c48eb', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:23:27.306409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] validate_networks() for [('fecf8741-4aac-48fd-b6b2-d491a4c0d8d5', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:23:28.169722 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:23:28.170788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:23:28.171353 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:23:28.172240 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:23:28.173113 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:23:28.185915 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:28.186882 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:28.187733 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:28.192448 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:28.195453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:28.196186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:28.230622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Getting quotas for project 4118102ca29c4b0fa344b21b9c9f1e85. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:23:28.237204 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Getting quotas for user 4f460a4884d1486484a683f440459b6e and project 4118102ca29c4b0fa344b21b9c9f1e85. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:23:28.255955 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:23:28.259772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:23:28.438124 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-18da105f-0167-4a6a-a7d1-8662c93e7710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.266112 Sep 19 17:23:28.451977 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 5/10] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:23:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:23:28.478406 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c593639-373f-4293-81d2-121a2109639f tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:28.479901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c593639-373f-4293-81d2-121a2109639f tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:28.491014 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c593639-373f-4293-81d2-121a2109639f tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:28.491938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c593639-373f-4293-81d2-121a2109639f tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:28.492568 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c593639-373f-4293-81d2-121a2109639f tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:28.493576 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c593639-373f-4293-81d2-121a2109639f tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:28.494234 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c593639-373f-4293-81d2-121a2109639f tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:28.495058 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c593639-373f-4293-81d2-121a2109639f tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:28.645610 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:23:28.646850 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:23:28.648284 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:23:28.648767 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:23:28.649355 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:23:28.669483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:28.672757 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:28.675242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:28.676833 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:28.677880 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:28.681050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:28.716183 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c593639-373f-4293-81d2-121a2109639f tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:28.730989 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c593639-373f-4293-81d2-121a2109639f tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1218 microversion: 2.1 time: 0.277546 Sep 19 17:23:28.732687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 6/11] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:28 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1218 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:28.742459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Getting quotas for project 1f148193008640639adb751706133b25. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:23:28.748540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Getting quotas for user 5c1fb1574d854a14bde2333da340d6a4 and project 1f148193008640639adb751706133b25. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:23:28.753880 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ac4acf0-aa31-47c2-9c4c-2f2cea98955d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:28.754612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3ac4acf0-aa31-47c2-9c4c-2f2cea98955d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:28.766350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:23:28.767763 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:23:28.884774 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ac4acf0-aa31-47c2-9c4c-2f2cea98955d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:28.894640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3ac4acf0-aa31-47c2-9c4c-2f2cea98955d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1221 microversion: 2.1 time: 0.148883 Sep 19 17:23:28.899105 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 7/12] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:28 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1221 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:28.968516 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a0f914b5-085f-49f1-844c-fb3595b70c95 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.058566 Sep 19 17:23:28.969485 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 6/13] 10.222.0.61 () {62 vars in 1188 bytes} [Mon Sep 19 17:23:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 17:23:28.981006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2fc8fee4-f3ae-4d0a-abb4-6ef1384a4731 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:28.981628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2fc8fee4-f3ae-4d0a-abb4-6ef1384a4731 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:29.115607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2fc8fee4-f3ae-4d0a-abb4-6ef1384a4731 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:29.128184 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2fc8fee4-f3ae-4d0a-abb4-6ef1384a4731 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:29.130904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2fc8fee4-f3ae-4d0a-abb4-6ef1384a4731 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:29.135052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2fc8fee4-f3ae-4d0a-abb4-6ef1384a4731 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1281 microversion: 2.20 time: 0.157183 Sep 19 17:23:29.148607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 8/14] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:28 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:29.756124 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5e5ea6f-e0d6-41eb-a5a1-5f8c7863723a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:29.756758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c5e5ea6f-e0d6-41eb-a5a1-5f8c7863723a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:29.767987 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea6f-e0d6-41eb-a5a1-5f8c7863723a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:29.768646 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea6f-e0d6-41eb-a5a1-5f8c7863723a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:29.770751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea6f-e0d6-41eb-a5a1-5f8c7863723a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:29.774135 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea6f-e0d6-41eb-a5a1-5f8c7863723a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:29.776053 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea6f-e0d6-41eb-a5a1-5f8c7863723a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:29.779664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea6f-e0d6-41eb-a5a1-5f8c7863723a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:29.924105 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c94d278e-324f-4b69-b9d5-0b0a66830578 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:29.925337 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c94d278e-324f-4b69-b9d5-0b0a66830578 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:29.932609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c94d278e-324f-4b69-b9d5-0b0a66830578 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:29.933337 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c94d278e-324f-4b69-b9d5-0b0a66830578 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:29.933936 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c94d278e-324f-4b69-b9d5-0b0a66830578 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:29.935123 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c94d278e-324f-4b69-b9d5-0b0a66830578 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:29.937511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c94d278e-324f-4b69-b9d5-0b0a66830578 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:29.938157 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c94d278e-324f-4b69-b9d5-0b0a66830578 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:29.970359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c5e5ea6f-e0d6-41eb-a5a1-5f8c7863723a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:29.987655 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c5e5ea6f-e0d6-41eb-a5a1-5f8c7863723a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1266 microversion: 2.1 time: 0.236146 Sep 19 17:23:29.990394 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 7/15] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:29 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:30.027985 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c94d278e-324f-4b69-b9d5-0b0a66830578 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:30.044222 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c94d278e-324f-4b69-b9d5-0b0a66830578 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1225 microversion: 2.1 time: 0.121506 Sep 19 17:23:30.048764 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 9/16] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:29 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:30.165894 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ec7ad23-3341-46aa-80a9-c237d8086c68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:30.167592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ec7ad23-3341-46aa-80a9-c237d8086c68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:30.263256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ec7ad23-3341-46aa-80a9-c237d8086c68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:30.276305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ec7ad23-3341-46aa-80a9-c237d8086c68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:30.280553 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ec7ad23-3341-46aa-80a9-c237d8086c68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:30.285131 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ec7ad23-3341-46aa-80a9-c237d8086c68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1281 microversion: 2.20 time: 0.121085 Sep 19 17:23:30.301728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 8/17] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:30 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:31.014198 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c23d35ab-96b7-43c0-aebc-24919d2aa810 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:31.015611 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c23d35ab-96b7-43c0-aebc-24919d2aa810 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:31.023161 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23d35ab-96b7-43c0-aebc-24919d2aa810 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:31.023682 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23d35ab-96b7-43c0-aebc-24919d2aa810 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:31.024146 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23d35ab-96b7-43c0-aebc-24919d2aa810 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:31.025072 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23d35ab-96b7-43c0-aebc-24919d2aa810 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:31.025818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23d35ab-96b7-43c0-aebc-24919d2aa810 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:31.027191 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23d35ab-96b7-43c0-aebc-24919d2aa810 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:31.073966 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-75847bd9-bfc0-46fc-9d11-3edf016a6f49 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:31.074673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-75847bd9-bfc0-46fc-9d11-3edf016a6f49 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:31.083263 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75847bd9-bfc0-46fc-9d11-3edf016a6f49 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:31.083940 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75847bd9-bfc0-46fc-9d11-3edf016a6f49 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:31.084392 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75847bd9-bfc0-46fc-9d11-3edf016a6f49 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:31.085279 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75847bd9-bfc0-46fc-9d11-3edf016a6f49 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:31.085910 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75847bd9-bfc0-46fc-9d11-3edf016a6f49 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:31.086359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75847bd9-bfc0-46fc-9d11-3edf016a6f49 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:31.102270 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c23d35ab-96b7-43c0-aebc-24919d2aa810 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:31.110114 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c23d35ab-96b7-43c0-aebc-24919d2aa810 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1266 microversion: 2.1 time: 0.100867 Sep 19 17:23:31.111112 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 10/18] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:31 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:31.158061 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-75847bd9-bfc0-46fc-9d11-3edf016a6f49 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:31.166405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-75847bd9-bfc0-46fc-9d11-3edf016a6f49 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1225 microversion: 2.1 time: 0.096152 Sep 19 17:23:31.167668 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 9/19] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:31 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:23:31.317278 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:31.317880 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:31.325024 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:31.325535 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:31.325948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:31.326648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:31.327073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:31.327583 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:31.395440 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:31.403849 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:31.405245 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:31.406345 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-12563c18-7fd2-40e5-b694-8d746db4b797 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1285 microversion: 2.20 time: 0.092998 Sep 19 17:23:31.406895 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:31 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:32.146665 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-39761a34-d9d2-4805-880a-153597ee0285 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:32.150937 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-39761a34-d9d2-4805-880a-153597ee0285 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:32.163971 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39761a34-d9d2-4805-880a-153597ee0285 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:32.164501 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39761a34-d9d2-4805-880a-153597ee0285 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:32.164961 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39761a34-d9d2-4805-880a-153597ee0285 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:32.165724 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39761a34-d9d2-4805-880a-153597ee0285 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:32.166188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39761a34-d9d2-4805-880a-153597ee0285 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:32.166638 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39761a34-d9d2-4805-880a-153597ee0285 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:32.189841 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-12c6f8e6-56c9-4a10-9193-a7cd1c74000c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:32.191301 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-12c6f8e6-56c9-4a10-9193-a7cd1c74000c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:32.198249 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c6f8e6-56c9-4a10-9193-a7cd1c74000c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:32.198745 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c6f8e6-56c9-4a10-9193-a7cd1c74000c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:32.199202 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c6f8e6-56c9-4a10-9193-a7cd1c74000c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:32.199933 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c6f8e6-56c9-4a10-9193-a7cd1c74000c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:32.201078 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c6f8e6-56c9-4a10-9193-a7cd1c74000c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:32.201566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c6f8e6-56c9-4a10-9193-a7cd1c74000c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:32.231807 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-39761a34-d9d2-4805-880a-153597ee0285 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:32.242292 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-39761a34-d9d2-4805-880a-153597ee0285 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1266 microversion: 2.1 time: 0.099459 Sep 19 17:23:32.242906 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 10/21] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:32 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:32.265197 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-12c6f8e6-56c9-4a10-9193-a7cd1c74000c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:32.273925 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-12c6f8e6-56c9-4a10-9193-a7cd1c74000c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1225 microversion: 2.1 time: 0.087912 Sep 19 17:23:32.274542 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 12/22] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:32 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:32.430795 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:32.431426 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:32.438051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:32.438488 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:32.438934 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:32.439645 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:32.440136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:32.440575 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:32.519562 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:32.531953 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:32.533408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:32.534609 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-155ad70a-9d47-402f-a1a8-96807e49bdae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1285 microversion: 2.20 time: 0.107738 Sep 19 17:23:32.535180 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 11/23] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:32 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:33.265478 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6b1aec5-e71b-479c-b539-30a6f1c6e394 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:33.266219 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6b1aec5-e71b-479c-b539-30a6f1c6e394 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:33.273004 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6b1aec5-e71b-479c-b539-30a6f1c6e394 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:33.273511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6b1aec5-e71b-479c-b539-30a6f1c6e394 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:33.273961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6b1aec5-e71b-479c-b539-30a6f1c6e394 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:33.274756 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6b1aec5-e71b-479c-b539-30a6f1c6e394 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:33.275227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6b1aec5-e71b-479c-b539-30a6f1c6e394 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:33.275664 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6b1aec5-e71b-479c-b539-30a6f1c6e394 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:33.297795 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aae31d4b-b630-4e7f-8eb0-a22ed5688c1e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:33.298426 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aae31d4b-b630-4e7f-8eb0-a22ed5688c1e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:33.312928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aae31d4b-b630-4e7f-8eb0-a22ed5688c1e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:33.313434 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aae31d4b-b630-4e7f-8eb0-a22ed5688c1e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:33.320597 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aae31d4b-b630-4e7f-8eb0-a22ed5688c1e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:33.321604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aae31d4b-b630-4e7f-8eb0-a22ed5688c1e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:33.322094 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aae31d4b-b630-4e7f-8eb0-a22ed5688c1e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:33.322538 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aae31d4b-b630-4e7f-8eb0-a22ed5688c1e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:33.355946 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a6b1aec5-e71b-479c-b539-30a6f1c6e394 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:33.369702 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a6b1aec5-e71b-479c-b539-30a6f1c6e394 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1266 microversion: 2.1 time: 0.108040 Sep 19 17:23:33.384319 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 13/24] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:33 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:33.446364 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-aae31d4b-b630-4e7f-8eb0-a22ed5688c1e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:33.455247 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aae31d4b-b630-4e7f-8eb0-a22ed5688c1e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1225 microversion: 2.1 time: 0.161963 Sep 19 17:23:33.456185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 12/25] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:33 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1225 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:23:33.559488 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:33.560341 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:33.566289 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:33.566777 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:33.567223 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:33.567972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:33.568437 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:33.568868 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:33.642320 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:33.652280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:33.654334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:33.655478 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09d6f395-ad5d-4245-abe0-2378d111139b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1285 microversion: 2.20 time: 0.099913 Sep 19 17:23:33.656055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 14/26] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:33 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:34.394993 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3f7c547a-e539-4023-b464-e67cc15a64e8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:34.395987 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3f7c547a-e539-4023-b464-e67cc15a64e8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:34.403219 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f7c547a-e539-4023-b464-e67cc15a64e8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:34.403943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f7c547a-e539-4023-b464-e67cc15a64e8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:34.404615 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f7c547a-e539-4023-b464-e67cc15a64e8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:34.405408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f7c547a-e539-4023-b464-e67cc15a64e8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:34.406098 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f7c547a-e539-4023-b464-e67cc15a64e8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:34.406721 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f7c547a-e539-4023-b464-e67cc15a64e8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:34.478601 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0db31f78-220e-4985-8cbf-91186941e7fa tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:34.480015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0db31f78-220e-4985-8cbf-91186941e7fa tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:34.493001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0db31f78-220e-4985-8cbf-91186941e7fa tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:34.493661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0db31f78-220e-4985-8cbf-91186941e7fa tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:34.493993 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f7c547a-e539-4023-b464-e67cc15a64e8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:34.494473 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0db31f78-220e-4985-8cbf-91186941e7fa tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:34.495195 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0db31f78-220e-4985-8cbf-91186941e7fa tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:34.495653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0db31f78-220e-4985-8cbf-91186941e7fa tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:34.496117 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0db31f78-220e-4985-8cbf-91186941e7fa tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:34.506452 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3f7c547a-e539-4023-b464-e67cc15a64e8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1284 microversion: 2.1 time: 0.115998 Sep 19 17:23:34.507571 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 13/27] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:34 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:34.680227 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:34.680864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:34.688004 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:34.688805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:34.689667 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:34.690680 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:34.691856 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:34.693198 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:34.749951 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0db31f78-220e-4985-8cbf-91186941e7fa tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:34.761878 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0db31f78-220e-4985-8cbf-91186941e7fa tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1217 microversion: 2.1 time: 0.287010 Sep 19 17:23:34.763622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 15/28] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:34 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1217 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:23:34.801851 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:34.822489 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:34.824004 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:34.825184 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9a504bd-e0e9-4955-9b71-5a6877ee759c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1277 microversion: 2.20 time: 0.148839 Sep 19 17:23:34.825840 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 14/29] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:34 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:23:35.531321 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-483b6cbc-6991-470d-b361-18a7f6fb5281 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:35.532606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-483b6cbc-6991-470d-b361-18a7f6fb5281 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:35.539399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483b6cbc-6991-470d-b361-18a7f6fb5281 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:35.540170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483b6cbc-6991-470d-b361-18a7f6fb5281 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:35.541019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483b6cbc-6991-470d-b361-18a7f6fb5281 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:35.541890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483b6cbc-6991-470d-b361-18a7f6fb5281 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:35.543133 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483b6cbc-6991-470d-b361-18a7f6fb5281 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:35.543741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483b6cbc-6991-470d-b361-18a7f6fb5281 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:35.789974 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6090307-3a6b-4ebc-ac41-3df1bdc2e80f tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] Calling method '.version_select at 0x7fd4d6cb63a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:36.210647 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6090307-3a6b-4ebc-ac41-3df1bdc2e80f tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/5d34df03-61b2-47ec-b26c-2a46d5b283a1" status: 200 len: 350 microversion: 2.1 time: 0.431509 Sep 19 17:23:36.212262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 15/30] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:23:35 2022] GET /compute/v2.1/os-volumes/5d34df03-61b2-47ec-b26c-2a46d5b283a1 => generated 350 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:23:36.217514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f97dbe6-017b-4f84-8923-56021e882852 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:36.218243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f97dbe6-017b-4f84-8923-56021e882852 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:36.241370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f97dbe6-017b-4f84-8923-56021e882852 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:36.252507 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f97dbe6-017b-4f84-8923-56021e882852 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:36.253208 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f97dbe6-017b-4f84-8923-56021e882852 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:36.255516 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f97dbe6-017b-4f84-8923-56021e882852 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:36.256424 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f97dbe6-017b-4f84-8923-56021e882852 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:36.258083 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f97dbe6-017b-4f84-8923-56021e882852 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:36.901325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7f97dbe6-017b-4f84-8923-56021e882852 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:36.909567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-483b6cbc-6991-470d-b361-18a7f6fb5281 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:36.910990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f97dbe6-017b-4f84-8923-56021e882852 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1273 microversion: 2.1 time: 0.234628 Sep 19 17:23:36.910990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 16/31] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:36 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:36.910990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:36.912213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-483b6cbc-6991-470d-b361-18a7f6fb5281 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.927678 Sep 19 17:23:36.912213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 16/32] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:35 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:36.912677 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:36.913016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f1a9b373-5aa5-4602-8e29-09cc8ced4f6c tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] Calling method '.version_select at 0x7fd4d6434a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:36.913233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:36.913233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:36.913233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:36.913233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:36.913633 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:36.913633 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:36.913633 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:36.913914 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:36.913914 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:36.913914 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bd21af71-b08e-4cac-8a4f-c0d572b1236d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1341 microversion: 2.20 time: 0.154065 Sep 19 17:23:36.914163 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 17/33] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:36 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1341 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:36.914257 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f1a9b373-5aa5-4602-8e29-09cc8ced4f6c tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.196983 Sep 19 17:23:36.914257 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 17/34] 10.222.0.61 () {58 vars in 1134 bytes} [Mon Sep 19 17:23:36 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:36.914400 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3b112f64-a8a0-4d87-97b0-558bc8135936 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] Calling method '.version_select at 0x7fd4d63e84c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:37.244528 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3b112f64-a8a0-4d87-97b0-558bc8135936 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.473220 Sep 19 17:23:37.254508 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 18/35] 10.222.0.61 () {58 vars in 1149 bytes} [Mon Sep 19 17:23:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:23:37.261101 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0cc92bad-4c82-4bbd-b6e1-8bf11f072352 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] Calling method '.version_select at 0x7fd4d63fc5e0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:37.541741 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2d5978c6-7910-4c44-853c-ced58f9323eb tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:37.542458 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2d5978c6-7910-4c44-853c-ced58f9323eb tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:37.553161 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d5978c6-7910-4c44-853c-ced58f9323eb tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:37.577231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d5978c6-7910-4c44-853c-ced58f9323eb tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:37.579475 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d5978c6-7910-4c44-853c-ced58f9323eb tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:37.580345 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d5978c6-7910-4c44-853c-ced58f9323eb tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:37.581338 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d5978c6-7910-4c44-853c-ced58f9323eb tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:37.581886 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d5978c6-7910-4c44-853c-ced58f9323eb tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:37.776421 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0cc92bad-4c82-4bbd-b6e1-8bf11f072352 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.519486 Sep 19 17:23:37.788571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 18/36] 10.222.0.61 () {58 vars in 1134 bytes} [Mon Sep 19 17:23:37 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:37.792413 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5cd91b4b-12bf-4788-91b1-8106fb208177 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:37.793031 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5cd91b4b-12bf-4788-91b1-8106fb208177 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:37.819035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd91b4b-12bf-4788-91b1-8106fb208177 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:37.819537 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd91b4b-12bf-4788-91b1-8106fb208177 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:37.820011 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd91b4b-12bf-4788-91b1-8106fb208177 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:37.821255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd91b4b-12bf-4788-91b1-8106fb208177 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:37.821738 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd91b4b-12bf-4788-91b1-8106fb208177 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:37.822167 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd91b4b-12bf-4788-91b1-8106fb208177 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:38.144292 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2d5978c6-7910-4c44-853c-ced58f9323eb tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:38.145678 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5cd91b4b-12bf-4788-91b1-8106fb208177 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:38.162258 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5cd91b4b-12bf-4788-91b1-8106fb208177 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1273 microversion: 2.1 time: 0.379575 Sep 19 17:23:38.162258 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 19/37] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:37 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1273 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:38.163808 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2d5978c6-7910-4c44-853c-ced58f9323eb tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.625904 Sep 19 17:23:38.167836 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 19/38] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:37 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:38.204690 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-46eae93f-335f-4416-ba42-15cf785b6746 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] Calling method '.version_select at 0x7fd4d639e820>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:38.207823 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:38.208580 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:38.217414 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:38.220381 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:38.221483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:38.223498 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:38.224863 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:38.225571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:38.226286 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:38.458393 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-46eae93f-335f-4416-ba42-15cf785b6746 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.289146 Sep 19 17:23:38.459062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 20/39] 10.222.0.61 () {58 vars in 1167 bytes} [Mon Sep 19 17:23:38 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:23:38.475086 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4235827d-efcc-463c-8768-1dd75dae6770 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] Calling method '.version_select at 0x7fd4d63e89d0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:38.646670 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4235827d-efcc-463c-8768-1dd75dae6770 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.175735 Sep 19 17:23:38.647955 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 21/40] 10.222.0.61 () {58 vars in 1170 bytes} [Mon Sep 19 17:23:38 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:23:38.663902 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-55528a4a-57a3-4aaf-83c2-23444e5d1b53 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] Calling method '.version_select at 0x7fd4d63e8e50>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:38.726967 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:38.831720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:38.862894 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:38.870416 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:38.874528 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03093d1b-adec-477c-9953-0958b7c65760 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.711891 Sep 19 17:23:38.876814 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:38 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:38.891233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-55528a4a-57a3-4aaf-83c2-23444e5d1b53 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.231190 Sep 19 17:23:38.892905 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 22/42] 10.222.0.61 () {58 vars in 1155 bytes} [Mon Sep 19 17:23:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:23:38.915607 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-323f0a85-814d-4f00-ab7b-f3ab4ce0ea78 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] Calling method '.version_select at 0x7fd4d63d9700>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:39.021715 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c2c7f52a-0dc2-4f47-8717-a31ddb02a4b8 req-671988a2-b006-412a-81bd-bc1c8cf27965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "174c5ef6-abf1-465c-afed-96d456b50c8e", "tag": "95fe2876-ad84-4782-b5da-88dc57844f07"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:39.032457 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c2c7f52a-0dc2-4f47-8717-a31ddb02a4b8 req-671988a2-b006-412a-81bd-bc1c8cf27965 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:39.033123 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c2c7f52a-0dc2-4f47-8717-a31ddb02a4b8 req-671988a2-b006-412a-81bd-bc1c8cf27965 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:39.033652 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c2c7f52a-0dc2-4f47-8717-a31ddb02a4b8 req-671988a2-b006-412a-81bd-bc1c8cf27965 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:39.068840 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c2c7f52a-0dc2-4f47-8717-a31ddb02a4b8 req-671988a2-b006-412a-81bd-bc1c8cf27965 service nova] Creating event network-changed:95fe2876-ad84-4782-b5da-88dc57844f07 for instance 174c5ef6-abf1-465c-afed-96d456b50c8e on hv-cinder-84801 Sep 19 17:23:39.069410 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c2c7f52a-0dc2-4f47-8717-a31ddb02a4b8 req-671988a2-b006-412a-81bd-bc1c8cf27965 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 17:23:39.072104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c2c7f52a-0dc2-4f47-8717-a31ddb02a4b8 req-671988a2-b006-412a-81bd-bc1c8cf27965 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 17:23:39.076662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3926d259-f21b-43b4-81b0-e0e34a89ce01 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:39.077286 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3926d259-f21b-43b4-81b0-e0e34a89ce01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:39.077741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3926d259-f21b-43b4-81b0-e0e34a89ce01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:39.078517 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3926d259-f21b-43b4-81b0-e0e34a89ce01 None None] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:39.079082 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3926d259-f21b-43b4-81b0-e0e34a89ce01 None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:39.079557 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3926d259-f21b-43b4-81b0-e0e34a89ce01 None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:39.111258 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.compute.rpcapi [None req-3926d259-f21b-43b4-81b0-e0e34a89ce01 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 17:23:39.111258 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3926d259-f21b-43b4-81b0-e0e34a89ce01 None None] Releasing lock "compute-rpcapi-router" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 17:23:39.125450 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=24 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:39.141633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3926d259-f21b-43b4-81b0-e0e34a89ce01 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261246 Sep 19 17:23:39.172008 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 21/43] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:23:39.188754 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2804b0f5-e951-4e9a-94d7-58a74b585fb8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:39.205668 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2804b0f5-e951-4e9a-94d7-58a74b585fb8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:39.207044 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2804b0f5-e951-4e9a-94d7-58a74b585fb8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:39.207602 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2804b0f5-e951-4e9a-94d7-58a74b585fb8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:39.208134 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2804b0f5-e951-4e9a-94d7-58a74b585fb8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:39.208924 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2804b0f5-e951-4e9a-94d7-58a74b585fb8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:39.210473 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2804b0f5-e951-4e9a-94d7-58a74b585fb8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:39.212108 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2804b0f5-e951-4e9a-94d7-58a74b585fb8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:39.222503 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-323f0a85-814d-4f00-ab7b-f3ab4ce0ea78 tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.310633 Sep 19 17:23:39.223074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 23/44] 10.222.0.61 () {58 vars in 1188 bytes} [Mon Sep 19 17:23:38 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:23:39.228110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e8027d4-6cf6-45ca-bd03-5744b752ea25 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:39.229166 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e8027d4-6cf6-45ca-bd03-5744b752ea25 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:39.250561 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e8027d4-6cf6-45ca-bd03-5744b752ea25 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:39.252185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e8027d4-6cf6-45ca-bd03-5744b752ea25 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:39.263410 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e8027d4-6cf6-45ca-bd03-5744b752ea25 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:39.263410 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e8027d4-6cf6-45ca-bd03-5744b752ea25 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:39.263410 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e8027d4-6cf6-45ca-bd03-5744b752ea25 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:39.263410 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e8027d4-6cf6-45ca-bd03-5744b752ea25 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:39.542819 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2804b0f5-e951-4e9a-94d7-58a74b585fb8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:39.560462 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2804b0f5-e951-4e9a-94d7-58a74b585fb8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1279 microversion: 2.1 time: 0.375205 Sep 19 17:23:39.561316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 22/45] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:39 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1279 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:39.588854 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6ddd4f5b-0904-43aa-b428-cd3d55ae9d0b tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] Calling method '.version_select at 0x7fd4d63e8a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:39.808467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2e8027d4-6cf6-45ca-bd03-5744b752ea25 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:39.817962 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e8027d4-6cf6-45ca-bd03-5744b752ea25 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.593539 Sep 19 17:23:39.818602 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 24/46] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:39 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:39.883055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6ddd4f5b-0904-43aa-b428-cd3d55ae9d0b tempest-VolumesTestJSON-1809830452 tempest-VolumesTestJSON-1809830452-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.306931 Sep 19 17:23:39.894531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 23/47] 10.222.0.61 () {58 vars in 1155 bytes} [Mon Sep 19 17:23:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:39.925458 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:39.926141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:39.934409 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:39.935350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:39.936208 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:39.937336 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:39.938007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:39.943608 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:40.272346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=18 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:40.299884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:40.323950 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:40.326415 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:40.327743 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ef44d187-ae28-495e-aa4d-cfd0376c7523 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.408962 Sep 19 17:23:40.348464 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 25/48] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:39 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:40.590962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fa5eef83-4c24-47a5-a2ca-b8b891a1f693 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:40.593119 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fa5eef83-4c24-47a5-a2ca-b8b891a1f693 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:40.612270 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa5eef83-4c24-47a5-a2ca-b8b891a1f693 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:40.617436 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa5eef83-4c24-47a5-a2ca-b8b891a1f693 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:40.629413 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa5eef83-4c24-47a5-a2ca-b8b891a1f693 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:40.630955 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa5eef83-4c24-47a5-a2ca-b8b891a1f693 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:40.634115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa5eef83-4c24-47a5-a2ca-b8b891a1f693 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:40.634995 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa5eef83-4c24-47a5-a2ca-b8b891a1f693 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:40.855900 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb224654-84c9-47b3-80c4-281ea1069a71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:40.857049 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fb224654-84c9-47b3-80c4-281ea1069a71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:40.879186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb224654-84c9-47b3-80c4-281ea1069a71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:40.879712 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb224654-84c9-47b3-80c4-281ea1069a71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:40.881457 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb224654-84c9-47b3-80c4-281ea1069a71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:40.882196 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb224654-84c9-47b3-80c4-281ea1069a71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:40.882661 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb224654-84c9-47b3-80c4-281ea1069a71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:40.883097 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb224654-84c9-47b3-80c4-281ea1069a71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:40.913086 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fa5eef83-4c24-47a5-a2ca-b8b891a1f693 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:40.923662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fa5eef83-4c24-47a5-a2ca-b8b891a1f693 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1279 microversion: 2.1 time: 0.338394 Sep 19 17:23:40.929106 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 24/49] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:40 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1279 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:41.056846 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0895e7ff-95cc-4716-ac4f-7c71d2143934 req-bc8f72ac-d075-48d1-a327-323634bcd24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c05ebb-0e1d-4420-b50a-c289b41715da", "tag": "9d69013e-49a8-47b6-be21-f1203cc13ade"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:41.080832 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0895e7ff-95cc-4716-ac4f-7c71d2143934 req-bc8f72ac-d075-48d1-a327-323634bcd24f service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:41.081323 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0895e7ff-95cc-4716-ac4f-7c71d2143934 req-bc8f72ac-d075-48d1-a327-323634bcd24f service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:41.081768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0895e7ff-95cc-4716-ac4f-7c71d2143934 req-bc8f72ac-d075-48d1-a327-323634bcd24f service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:41.124250 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0895e7ff-95cc-4716-ac4f-7c71d2143934 req-bc8f72ac-d075-48d1-a327-323634bcd24f service nova] Creating event network-changed:9d69013e-49a8-47b6-be21-f1203cc13ade for instance 16c05ebb-0e1d-4420-b50a-c289b41715da on hv-cinder-84801 Sep 19 17:23:41.132186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0895e7ff-95cc-4716-ac4f-7c71d2143934 req-bc8f72ac-d075-48d1-a327-323634bcd24f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201324 Sep 19 17:23:41.135539 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 25/50] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:23:41.268904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fb224654-84c9-47b3-80c4-281ea1069a71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:41.287062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb224654-84c9-47b3-80c4-281ea1069a71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.434776 Sep 19 17:23:41.294052 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 26/51] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:40 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:41.381599 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:41.382310 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:41.390750 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:41.391906 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:41.392500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:41.393357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:41.393961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:41.395028 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:41.617536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:41.645984 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:41.647199 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:41.650500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1a7ab5b6-c9e7-4022-ac46-6b716bec3e70 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.296031 Sep 19 17:23:41.651912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 26/52] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:41 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:41.957381 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c937127-c714-4e8e-88b8-9303121d4e40 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:41.957927 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c937127-c714-4e8e-88b8-9303121d4e40 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:41.974395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c937127-c714-4e8e-88b8-9303121d4e40 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:41.977892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c937127-c714-4e8e-88b8-9303121d4e40 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:41.977892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c937127-c714-4e8e-88b8-9303121d4e40 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:41.977892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c937127-c714-4e8e-88b8-9303121d4e40 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:41.977892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c937127-c714-4e8e-88b8-9303121d4e40 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:41.978476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c937127-c714-4e8e-88b8-9303121d4e40 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:42.046060 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-4485aa5b-b04b-4c9f-a75e-f82eef77f1be req-5d4b097a-7a5b-4733-b9e3-d0d3d7d881b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2eb485-3b5a-4326-bd4f-9029da4e6744", "tag": "e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:42.073214 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4485aa5b-b04b-4c9f-a75e-f82eef77f1be req-5d4b097a-7a5b-4733-b9e3-d0d3d7d881b7 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:42.073944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4485aa5b-b04b-4c9f-a75e-f82eef77f1be req-5d4b097a-7a5b-4733-b9e3-d0d3d7d881b7 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:42.074541 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4485aa5b-b04b-4c9f-a75e-f82eef77f1be req-5d4b097a-7a5b-4733-b9e3-d0d3d7d881b7 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:42.092308 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-4485aa5b-b04b-4c9f-a75e-f82eef77f1be req-5d4b097a-7a5b-4733-b9e3-d0d3d7d881b7 service nova] Creating event network-changed:e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43 for instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 on hv-cinder-84801 Sep 19 17:23:42.117309 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-4485aa5b-b04b-4c9f-a75e-f82eef77f1be req-5d4b097a-7a5b-4733-b9e3-d0d3d7d881b7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075275 Sep 19 17:23:42.118448 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 27/53] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:23:42.254668 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c937127-c714-4e8e-88b8-9303121d4e40 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:42.291956 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c937127-c714-4e8e-88b8-9303121d4e40 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.334002 Sep 19 17:23:42.291956 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 27/54] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:41 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:42.319427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3e3b7e4d-c401-4991-9da9-84ba55259e15 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:42.327113 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3e3b7e4d-c401-4991-9da9-84ba55259e15 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:42.338611 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e3b7e4d-c401-4991-9da9-84ba55259e15 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:42.341375 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e3b7e4d-c401-4991-9da9-84ba55259e15 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:42.342403 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e3b7e4d-c401-4991-9da9-84ba55259e15 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:42.343273 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e3b7e4d-c401-4991-9da9-84ba55259e15 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:42.343908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e3b7e4d-c401-4991-9da9-84ba55259e15 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:42.344488 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e3b7e4d-c401-4991-9da9-84ba55259e15 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:42.355082 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:42.676857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:42.677575 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:42.687861 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:42.688359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:42.688790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:42.689943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:42.692862 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:42.693556 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:42.951843 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3e3b7e4d-c401-4991-9da9-84ba55259e15 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:42.963902 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3e3b7e4d-c401-4991-9da9-84ba55259e15 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.652467 Sep 19 17:23:42.966572 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 28/55] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:42 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:43.143809 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:43.156167 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:43.174895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:43.174895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aac7ff83-cbb2-4879-8a5b-5657032237a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.486054 Sep 19 17:23:43.174895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 28/56] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:42 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:43.326876 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72919d64-2df2-46c7-8d74-1476c4b2553d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:43.327419 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-72919d64-2df2-46c7-8d74-1476c4b2553d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:43.357310 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72919d64-2df2-46c7-8d74-1476c4b2553d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:43.357805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72919d64-2df2-46c7-8d74-1476c4b2553d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:43.358240 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72919d64-2df2-46c7-8d74-1476c4b2553d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:43.358946 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72919d64-2df2-46c7-8d74-1476c4b2553d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:43.359571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72919d64-2df2-46c7-8d74-1476c4b2553d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:43.360792 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72919d64-2df2-46c7-8d74-1476c4b2553d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:43.807005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-72919d64-2df2-46c7-8d74-1476c4b2553d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:43.820890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72919d64-2df2-46c7-8d74-1476c4b2553d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.513006 Sep 19 17:23:43.821606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 29/57] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:43 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:44.001253 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d766eb6-ef04-45a5-81fb-335178434bbd tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:44.003050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d766eb6-ef04-45a5-81fb-335178434bbd tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:44.016062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d766eb6-ef04-45a5-81fb-335178434bbd tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:44.016686 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d766eb6-ef04-45a5-81fb-335178434bbd tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:44.017439 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d766eb6-ef04-45a5-81fb-335178434bbd tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:44.018466 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d766eb6-ef04-45a5-81fb-335178434bbd tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:44.020338 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d766eb6-ef04-45a5-81fb-335178434bbd tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:44.022003 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d766eb6-ef04-45a5-81fb-335178434bbd tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:44.190539 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:44.191918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:44.196517 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:44.205082 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:44.208182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:44.208876 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:44.209838 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:44.213142 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:44.213894 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:44.703305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d766eb6-ef04-45a5-81fb-335178434bbd tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:44.739181 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:44.741913 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d766eb6-ef04-45a5-81fb-335178434bbd tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.722549 Sep 19 17:23:44.741913 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 29/58] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:43 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:44.755746 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:44.777719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:44.781146 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47fad2dc-9425-485f-93ed-03ce1879ad1a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.594479 Sep 19 17:23:44.782115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 30/59] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:44 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:23:44.844764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d25c64d-e1be-41e6-9d9c-9fbad237a32d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:44.845799 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d25c64d-e1be-41e6-9d9c-9fbad237a32d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:44.868260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d25c64d-e1be-41e6-9d9c-9fbad237a32d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:44.868260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d25c64d-e1be-41e6-9d9c-9fbad237a32d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:44.868260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d25c64d-e1be-41e6-9d9c-9fbad237a32d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:44.868260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d25c64d-e1be-41e6-9d9c-9fbad237a32d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:44.868679 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d25c64d-e1be-41e6-9d9c-9fbad237a32d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:44.868679 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d25c64d-e1be-41e6-9d9c-9fbad237a32d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:44.875542 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:45.236772 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d25c64d-e1be-41e6-9d9c-9fbad237a32d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:45.249112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d25c64d-e1be-41e6-9d9c-9fbad237a32d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.408091 Sep 19 17:23:45.265003 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 30/60] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:44 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:45.477939 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f5ec17c8-daac-4247-875f-349f4d6aca3b req-762256cc-d67d-4f42-9f70-80b081574854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f141f191-3cdc-4eef-8f61-bea738735537", "tag": "e5a3c33b-3371-42fa-9473-41736f479159"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:45.506098 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f5ec17c8-daac-4247-875f-349f4d6aca3b req-762256cc-d67d-4f42-9f70-80b081574854 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:45.506937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f5ec17c8-daac-4247-875f-349f4d6aca3b req-762256cc-d67d-4f42-9f70-80b081574854 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:45.509280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f5ec17c8-daac-4247-875f-349f4d6aca3b req-762256cc-d67d-4f42-9f70-80b081574854 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:45.536317 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f5ec17c8-daac-4247-875f-349f4d6aca3b req-762256cc-d67d-4f42-9f70-80b081574854 service nova] Creating event network-changed:e5a3c33b-3371-42fa-9473-41736f479159 for instance f141f191-3cdc-4eef-8f61-bea738735537 on hv-cinder-84801 Sep 19 17:23:45.545268 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f5ec17c8-daac-4247-875f-349f4d6aca3b req-762256cc-d67d-4f42-9f70-80b081574854 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074109 Sep 19 17:23:45.553456 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 31/61] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:23:45.752200 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-55adfa8c-3003-46c4-ae13-2bd5c7401502 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:45.753079 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-55adfa8c-3003-46c4-ae13-2bd5c7401502 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:45.769391 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55adfa8c-3003-46c4-ae13-2bd5c7401502 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:45.769888 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55adfa8c-3003-46c4-ae13-2bd5c7401502 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:45.770367 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55adfa8c-3003-46c4-ae13-2bd5c7401502 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:45.771059 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55adfa8c-3003-46c4-ae13-2bd5c7401502 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:45.773572 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55adfa8c-3003-46c4-ae13-2bd5c7401502 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:45.778070 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55adfa8c-3003-46c4-ae13-2bd5c7401502 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:45.810035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:45.811455 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:45.830201 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:45.830937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:45.831788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:45.833602 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:45.834579 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:45.836296 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:46.322900 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:46.338369 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:46.350407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:46.354872 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3fc1dbcf-c2d8-424d-a7f4-b70518a44411 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.551623 Sep 19 17:23:46.360743 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:45 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:46.377575 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-35134fd7-b5df-4a33-83bf-c83376a12f93 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:46.381176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-35134fd7-b5df-4a33-83bf-c83376a12f93 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:46.397533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35134fd7-b5df-4a33-83bf-c83376a12f93 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:46.401291 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35134fd7-b5df-4a33-83bf-c83376a12f93 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:46.401921 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35134fd7-b5df-4a33-83bf-c83376a12f93 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:46.402807 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35134fd7-b5df-4a33-83bf-c83376a12f93 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:46.403993 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35134fd7-b5df-4a33-83bf-c83376a12f93 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:46.408494 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35134fd7-b5df-4a33-83bf-c83376a12f93 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:46.594692 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-55adfa8c-3003-46c4-ae13-2bd5c7401502 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:46.610719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-55adfa8c-3003-46c4-ae13-2bd5c7401502 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.863520 Sep 19 17:23:46.613826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 31/63] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:45 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:46.767047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-35134fd7-b5df-4a33-83bf-c83376a12f93 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:46.779733 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-35134fd7-b5df-4a33-83bf-c83376a12f93 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.416384 Sep 19 17:23:46.789626 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 33/64] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:46 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:47.394898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:47.395519 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:47.412090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:47.413039 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:47.413778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:47.414997 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:47.415756 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:47.416630 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:47.641480 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-814f41b0-f797-49ee-b1d8-284e331d1e11 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:47.642427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-814f41b0-f797-49ee-b1d8-284e331d1e11 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:47.661436 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814f41b0-f797-49ee-b1d8-284e331d1e11 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:47.664225 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814f41b0-f797-49ee-b1d8-284e331d1e11 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:47.666140 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814f41b0-f797-49ee-b1d8-284e331d1e11 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:47.668292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814f41b0-f797-49ee-b1d8-284e331d1e11 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:47.670961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814f41b0-f797-49ee-b1d8-284e331d1e11 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:47.671744 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814f41b0-f797-49ee-b1d8-284e331d1e11 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:47.692004 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:47.701493 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:47.703135 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:47.704977 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-36711392-11d9-4f72-9466-1a238bcdb81d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.314628 Sep 19 17:23:47.706190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:47 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:47.812787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e959f831-9322-42b0-b869-8036b98dd3d3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:47.813455 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e959f831-9322-42b0-b869-8036b98dd3d3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:47.833803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e959f831-9322-42b0-b869-8036b98dd3d3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:47.836310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e959f831-9322-42b0-b869-8036b98dd3d3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:47.841396 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e959f831-9322-42b0-b869-8036b98dd3d3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:47.845223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e959f831-9322-42b0-b869-8036b98dd3d3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:47.845223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e959f831-9322-42b0-b869-8036b98dd3d3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:47.845223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e959f831-9322-42b0-b869-8036b98dd3d3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:47.991783 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-814f41b0-f797-49ee-b1d8-284e331d1e11 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:48.003980 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-814f41b0-f797-49ee-b1d8-284e331d1e11 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.370759 Sep 19 17:23:48.004659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 34/66] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:47 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:48.097764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e959f831-9322-42b0-b869-8036b98dd3d3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:48.116290 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e959f831-9322-42b0-b869-8036b98dd3d3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.306109 Sep 19 17:23:48.116290 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 33/67] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:47 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:48.734675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:48.735289 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:48.742702 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:48.743196 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:48.743639 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:48.744424 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:48.744887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:48.745315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:48.891846 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:48.900855 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:48.902635 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:48.904620 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba7e13ac-b36f-4d7b-bfee-4b17d982bc8c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.174863 Sep 19 17:23:48.905363 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:48 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:49.026861 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cec3e353-d06f-4c61-b42a-f7b1265cb2b8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:49.029232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cec3e353-d06f-4c61-b42a-f7b1265cb2b8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:49.036533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cec3e353-d06f-4c61-b42a-f7b1265cb2b8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:49.037034 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cec3e353-d06f-4c61-b42a-f7b1265cb2b8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:49.037480 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cec3e353-d06f-4c61-b42a-f7b1265cb2b8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:49.038189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cec3e353-d06f-4c61-b42a-f7b1265cb2b8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:49.038800 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cec3e353-d06f-4c61-b42a-f7b1265cb2b8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:49.039242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cec3e353-d06f-4c61-b42a-f7b1265cb2b8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:49.144526 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-536a632d-30a3-4e57-bdf7-047b8703dba6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:49.150453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-536a632d-30a3-4e57-bdf7-047b8703dba6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:49.157858 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:49.160104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-536a632d-30a3-4e57-bdf7-047b8703dba6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:49.160866 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-536a632d-30a3-4e57-bdf7-047b8703dba6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:49.162212 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-536a632d-30a3-4e57-bdf7-047b8703dba6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:49.163338 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-536a632d-30a3-4e57-bdf7-047b8703dba6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:49.164298 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-536a632d-30a3-4e57-bdf7-047b8703dba6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:49.164844 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-536a632d-30a3-4e57-bdf7-047b8703dba6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:49.202718 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-cec3e353-d06f-4c61-b42a-f7b1265cb2b8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:49.210653 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cec3e353-d06f-4c61-b42a-f7b1265cb2b8 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.187689 Sep 19 17:23:49.211242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 34/69] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:49 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:49.356938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-536a632d-30a3-4e57-bdf7-047b8703dba6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:49.379355 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-536a632d-30a3-4e57-bdf7-047b8703dba6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.241653 Sep 19 17:23:49.380801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 36/70] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:49 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:49.418530 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29ba996b-b3b6-49a2-acdc-a38986e7cd50 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Action: 'create', calling method: .version_select at 0x7fd4d639ea60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1254076560", "metadata": {"Type": "work"}}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29ba996b-b3b6-49a2-acdc-a38986e7cd50 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Request method failure captured: Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 122 Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKWlQNvvjP-KinH5r79_qzFuZxM30Qd2hL6HM8sQgN_D8h2hQ5X3mrxoZoPFPM6t7y3WqXH_T78EU1IHgOavfmrkGKwWkGncRYbxZVccGC5IKSKAuV3MJqq_tWZL6OnhQYdeMR82yFoh3_L2YuP8lbF2E4S87PVgle6MQA3WvIfA92w Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:23:49.439318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2693c736c50543738ed8897349805d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2693c736c50543738ed8897349805d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}] Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 36ca95b043f1425a90a4f90d4368052d Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1254076560", "metadata": {"Type": "work"}}} Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: Sep 19 17:23:49.444266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1254076560', 'metadata': {'Type': 'work'}}}} Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi '#$%' Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:23:49.445569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 17:23:49.447179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 17:23:49.448914 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 17:23:49.448914 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.450876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29ba996b-b3b6-49a2-acdc-a38986e7cd50 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:23:49.452533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-29ba996b-b3b6-49a2-acdc-a38986e7cd50 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.230666 Sep 19 17:23:49.453646 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 35/71] 10.222.0.61 () {60 vars in 1156 bytes} [Mon Sep 19 17:23:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 17:23:49.465894 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e836fe4b-334e-4d53-8006-e362cd41b90e tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Action: 'create', calling method: .version_select at 0x7fd4d640ed30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1639877318", "metadata": {"Type": "work"}}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e836fe4b-334e-4d53-8006-e362cd41b90e tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Request method failure captured: Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 120 Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWlQNvvjP-KinH5r79_qzFuZxM30Qd2hL6HM8sQgN_D8h2hQ5X3mrxoZoPFPM6t7y3WqXH_T78EU1IHgOavfmrkGKwWkGncRYbxZVccGC5IKSKAuV3MJqq_tWZL6OnhQYdeMR82yFoh3_L2YuP8lbF2E4S87PVgle6MQA3WvIfA92w Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:23:49.472589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2693c736c50543738ed8897349805d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2693c736c50543738ed8897349805d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}] Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 36ca95b043f1425a90a4f90d4368052d Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1639877318", "metadata": {"Type": "work"}}} Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: Sep 19 17:23:49.473972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1639877318', 'metadata': {'Type': 'work'}}}} Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi '0' Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:23:49.474759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 17:23:49.476446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 17:23:49.477591 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 17:23:49.477591 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.477591 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e836fe4b-334e-4d53-8006-e362cd41b90e tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:23:49.477591 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e836fe4b-334e-4d53-8006-e362cd41b90e tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012781 Sep 19 17:23:49.477591 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1156 bytes} [Mon Sep 19 17:23:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 17:23:49.486022 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cb6a8adc-b76f-4493-9d00-ea3301afad16 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Action: 'create', calling method: .version_select at 0x7fd4d63d9550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-844380735", "metadata": {"Type": "work"}}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cb6a8adc-b76f-4493-9d00-ea3301afad16 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Request method failure captured: Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 118 Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKWlQNvvjP-KinH5r79_qzFuZxM30Qd2hL6HM8sQgN_D8h2hQ5X3mrxoZoPFPM6t7y3WqXH_T78EU1IHgOavfmrkGKwWkGncRYbxZVccGC5IKSKAuV3MJqq_tWZL6OnhQYdeMR82yFoh3_L2YuP8lbF2E4S87PVgle6MQA3WvIfA92w Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:23:49.490898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2693c736c50543738ed8897349805d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2693c736c50543738ed8897349805d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}] Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 36ca95b043f1425a90a4f90d4368052d Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-844380735", "metadata": {"Type": "work"}}} Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: Sep 19 17:23:49.492181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-844380735', 'metadata': {'Type': 'work'}}}} Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi '' Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:23:49.492958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 17:23:49.501789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 17:23:49.503892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 17:23:49.503892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.503892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cb6a8adc-b76f-4493-9d00-ea3301afad16 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:23:49.503892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cb6a8adc-b76f-4493-9d00-ea3301afad16 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010248 Sep 19 17:23:49.503892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 36/73] 10.222.0.61 () {60 vars in 1156 bytes} [Mon Sep 19 17:23:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 17:23:49.504338 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e402e8bf-a91a-4032-9ad5-9e2d85b613c9 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Calling method '.version_select at 0x7fd4d63e83a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:49.539420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e402e8bf-a91a-4032-9ad5-9e2d85b613c9 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] HTTP exception thrown: Volume tempest-invalid-1325909879 could not be found. Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e402e8bf-a91a-4032-9ad5-9e2d85b613c9 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Request method failure captured: Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1325909879 HTTP/1.1 Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWlQNvvjP-KinH5r79_qzFuZxM30Qd2hL6HM8sQgN_D8h2hQ5X3mrxoZoPFPM6t7y3WqXH_T78EU1IHgOavfmrkGKwWkGncRYbxZVccGC5IKSKAuV3MJqq_tWZL6OnhQYdeMR82yFoh3_L2YuP8lbF2E4S87PVgle6MQA3WvIfA92w Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:23:49.543458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2693c736c50543738ed8897349805d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2693c736c50543738ed8897349805d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}] Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 36ca95b043f1425a90a4f90d4368052d Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Volume tempest-invalid-1325909879 could not be found. Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': 'tempest-invalid-1325909879'} Sep 19 17:23:49.545548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1325909879 could not be found. (HTTP 404) (Request-ID: req-028bc0a1-6cd5-42e6-af23-d98ce5512b2f) Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.548294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 17:23:49.549423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1325909879 could not be found. Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:23:49.550717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1325909879 could not be found. Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1325909879 could not be found. Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e402e8bf-a91a-4032-9ad5-9e2d85b613c9 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Returning 404 to user: Volume tempest-invalid-1325909879 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e402e8bf-a91a-4032-9ad5-9e2d85b613c9 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1325909879" status: 404 len: 99 microversion: 2.1 time: 0.046340 Sep 19 17:23:49.551867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 38/74] 10.222.0.61 () {58 vars in 1218 bytes} [Mon Sep 19 17:23:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1325909879 => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 17:23:49.557055 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e514b8e2-743e-4049-b06f-9ccb22f0a5f3 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005945 Sep 19 17:23:49.564186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 37/75] 10.222.0.61 () {58 vars in 1140 bytes} [Mon Sep 19 17:23:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 17:23:49.569390 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ac85422-08f2-4aee-80d1-ba4d9b1dac9c tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004128 Sep 19 17:23:49.569903 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 39/76] 10.222.0.61 () {58 vars in 1137 bytes} [Mon Sep 19 17:23:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 17:23:49.585603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86413651-e317-4a64-8bc6-a3ee128a7965 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Calling method '.version_select at 0x7fd4d639eee0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:49.615323 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-86413651-e317-4a64-8bc6-a3ee128a7965 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] HTTP exception thrown: Volume 8df19e61-5251-4b68-9b64-f002c579c50b could not be found. Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86413651-e317-4a64-8bc6-a3ee128a7965 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Request method failure captured: Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: DELETE /compute/v2.1/os-volumes/8df19e61-5251-4b68-9b64-f002c579c50b HTTP/1.1 Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKWlQNvvjP-KinH5r79_qzFuZxM30Qd2hL6HM8sQgN_D8h2hQ5X3mrxoZoPFPM6t7y3WqXH_T78EU1IHgOavfmrkGKwWkGncRYbxZVccGC5IKSKAuV3MJqq_tWZL6OnhQYdeMR82yFoh3_L2YuP8lbF2E4S87PVgle6MQA3WvIfA92w Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:23:49.618985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2693c736c50543738ed8897349805d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2693c736c50543738ed8897349805d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}] Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 36ca95b043f1425a90a4f90d4368052d Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Volume 8df19e61-5251-4b68-9b64-f002c579c50b could not be found. Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '8df19e61-5251-4b68-9b64-f002c579c50b'} Sep 19 17:23:49.620136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8df19e61-5251-4b68-9b64-f002c579c50b could not be found. (HTTP 404) (Request-ID: req-9b7567e4-7eb7-4500-b86c-cd0033da3522) Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.620787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 17:23:49.622403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8df19e61-5251-4b68-9b64-f002c579c50b could not be found. Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 17:23:49.623550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8df19e61-5251-4b68-9b64-f002c579c50b could not be found. Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8df19e61-5251-4b68-9b64-f002c579c50b could not be found. Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86413651-e317-4a64-8bc6-a3ee128a7965 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Returning 404 to user: Volume 8df19e61-5251-4b68-9b64-f002c579c50b could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86413651-e317-4a64-8bc6-a3ee128a7965 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/8df19e61-5251-4b68-9b64-f002c579c50b" status: 404 len: 109 microversion: 2.1 time: 0.042654 Sep 19 17:23:49.625133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 38/77] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Sep 19 17:23:49 2022] DELETE /compute/v2.1/os-volumes/8df19e61-5251-4b68-9b64-f002c579c50b => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:23:49.631350 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5c355d7-106c-443f-8522-90586366c849 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Calling method '.version_select at 0x7fd4d63e8280>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:49.659922 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-d5c355d7-106c-443f-8522-90586366c849 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] HTTP exception thrown: Volume 282b3c30-6899-46ff-9000-1675ca252658 could not be found. Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5c355d7-106c-443f-8522-90586366c849 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Request method failure captured: Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/os-volumes/282b3c30-6899-46ff-9000-1675ca252658 HTTP/1.1 Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWlQNvvjP-KinH5r79_qzFuZxM30Qd2hL6HM8sQgN_D8h2hQ5X3mrxoZoPFPM6t7y3WqXH_T78EU1IHgOavfmrkGKwWkGncRYbxZVccGC5IKSKAuV3MJqq_tWZL6OnhQYdeMR82yFoh3_L2YuP8lbF2E4S87PVgle6MQA3WvIfA92w Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:23:49.666217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2693c736c50543738ed8897349805d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2693c736c50543738ed8897349805d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2693c736c50543738ed8897349805d69"}]}] Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 2693c736c50543738ed8897349805d69 Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesNegativeTest-1931075093 Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 36ca95b043f1425a90a4f90d4368052d Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-VolumesNegativeTest-1931075093-project Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Volume 282b3c30-6899-46ff-9000-1675ca252658 could not be found. Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '282b3c30-6899-46ff-9000-1675ca252658'} Sep 19 17:23:49.667482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 282b3c30-6899-46ff-9000-1675ca252658 could not be found. (HTTP 404) (Request-ID: req-1b65ec77-bcbc-4130-93ca-2d3d1032ec6b) Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.668263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 17:23:49.669434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 282b3c30-6899-46ff-9000-1675ca252658 could not be found. Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 17:23:49.670392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 282b3c30-6899-46ff-9000-1675ca252658 could not be found. Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 282b3c30-6899-46ff-9000-1675ca252658 could not be found. Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5c355d7-106c-443f-8522-90586366c849 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] Returning 404 to user: Volume 282b3c30-6899-46ff-9000-1675ca252658 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5c355d7-106c-443f-8522-90586366c849 tempest-VolumesNegativeTest-1931075093 tempest-VolumesNegativeTest-1931075093-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/282b3c30-6899-46ff-9000-1675ca252658" status: 404 len: 109 microversion: 2.1 time: 0.036092 Sep 19 17:23:49.671571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 40/78] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:23:49 2022] GET /compute/v2.1/os-volumes/282b3c30-6899-46ff-9000-1675ca252658 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:23:49.937851 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:49.937851 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:49.940749 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:49.941238 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:49.941683 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:49.942447 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:49.942930 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:49.943360 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:50.085217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:50.095301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:50.111841 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:50.111841 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-895a55d0-1be1-4899-921f-862524a7924e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.170333 Sep 19 17:23:50.111841 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 39/79] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:49 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:50.236260 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9abbe28c-7eb7-4d19-8e42-52f35d63a2a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:50.236870 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9abbe28c-7eb7-4d19-8e42-52f35d63a2a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:50.244155 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abbe28c-7eb7-4d19-8e42-52f35d63a2a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:50.244650 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abbe28c-7eb7-4d19-8e42-52f35d63a2a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:50.245090 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abbe28c-7eb7-4d19-8e42-52f35d63a2a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:50.245794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abbe28c-7eb7-4d19-8e42-52f35d63a2a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:50.246255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abbe28c-7eb7-4d19-8e42-52f35d63a2a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:50.247335 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abbe28c-7eb7-4d19-8e42-52f35d63a2a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:50.403721 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-de455f04-2705-4717-919b-f15a84564b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:50.404469 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-de455f04-2705-4717-919b-f15a84564b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:50.411734 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de455f04-2705-4717-919b-f15a84564b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:50.418446 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de455f04-2705-4717-919b-f15a84564b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:50.418446 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de455f04-2705-4717-919b-f15a84564b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:50.418446 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de455f04-2705-4717-919b-f15a84564b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:50.418446 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de455f04-2705-4717-919b-f15a84564b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:50.419838 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de455f04-2705-4717-919b-f15a84564b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:50.420073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9abbe28c-7eb7-4d19-8e42-52f35d63a2a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:50.429619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9abbe28c-7eb7-4d19-8e42-52f35d63a2a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.197077 Sep 19 17:23:50.430748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 41/80] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:50 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:50.641962 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-de455f04-2705-4717-919b-f15a84564b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:50.650453 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-de455f04-2705-4717-919b-f15a84564b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.251573 Sep 19 17:23:50.662121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 40/81] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:50 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:51.127406 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:51.128711 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:51.138852 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:51.140768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:51.140768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:51.141368 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:51.142016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:51.142633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:51.290458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:51.301169 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:51.302907 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:51.304255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1e28cc52-ba56-449c-83e9-b7ffcd66b804 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.182501 Sep 19 17:23:51.305154 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 42/82] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:51 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:51.459684 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-83dd9973-df94-4ea9-a747-50b336283539 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:51.461151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-83dd9973-df94-4ea9-a747-50b336283539 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:51.462830 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:51.468925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83dd9973-df94-4ea9-a747-50b336283539 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:51.468925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83dd9973-df94-4ea9-a747-50b336283539 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:51.469335 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83dd9973-df94-4ea9-a747-50b336283539 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:51.469923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83dd9973-df94-4ea9-a747-50b336283539 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:51.471301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83dd9973-df94-4ea9-a747-50b336283539 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:51.471916 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83dd9973-df94-4ea9-a747-50b336283539 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:51.634566 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-83dd9973-df94-4ea9-a747-50b336283539 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:51.642565 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-83dd9973-df94-4ea9-a747-50b336283539 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.189154 Sep 19 17:23:51.643829 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 41/83] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:51 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:51.675054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-edff8f43-b329-49e8-abf0-5073267734e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:51.675907 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-edff8f43-b329-49e8-abf0-5073267734e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:51.682326 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edff8f43-b329-49e8-abf0-5073267734e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:51.683152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edff8f43-b329-49e8-abf0-5073267734e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:51.683887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edff8f43-b329-49e8-abf0-5073267734e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:51.685423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edff8f43-b329-49e8-abf0-5073267734e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:51.689829 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edff8f43-b329-49e8-abf0-5073267734e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:51.689829 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edff8f43-b329-49e8-abf0-5073267734e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:51.843178 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-edff8f43-b329-49e8-abf0-5073267734e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:51.851158 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-edff8f43-b329-49e8-abf0-5073267734e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.180861 Sep 19 17:23:51.856531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 43/84] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:51 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:52.332088 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:52.333525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:52.344227 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:52.347125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:52.353651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:52.353651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:52.353651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:52.353651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:52.538591 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:52.549912 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:52.552413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:52.553985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5d4dd40e-b272-4e77-9121-b3996334663a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.227005 Sep 19 17:23:52.576431 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 42/85] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:52 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:52.672207 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-acbb2c9b-4f76-434c-8675-897c0f55c4d9 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:52.672961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-acbb2c9b-4f76-434c-8675-897c0f55c4d9 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:52.678900 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb2c9b-4f76-434c-8675-897c0f55c4d9 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:52.683048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb2c9b-4f76-434c-8675-897c0f55c4d9 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:52.683048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb2c9b-4f76-434c-8675-897c0f55c4d9 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:52.683048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb2c9b-4f76-434c-8675-897c0f55c4d9 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:52.683048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb2c9b-4f76-434c-8675-897c0f55c4d9 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:52.683450 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb2c9b-4f76-434c-8675-897c0f55c4d9 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:52.841234 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-acbb2c9b-4f76-434c-8675-897c0f55c4d9 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:52.850379 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-acbb2c9b-4f76-434c-8675-897c0f55c4d9 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.182593 Sep 19 17:23:52.850962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 44/86] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:52 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:52.874283 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f527b040-6328-454b-83fd-b5925df3da50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:52.874892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f527b040-6328-454b-83fd-b5925df3da50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:52.881097 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f527b040-6328-454b-83fd-b5925df3da50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:52.881578 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f527b040-6328-454b-83fd-b5925df3da50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:52.882011 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f527b040-6328-454b-83fd-b5925df3da50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:52.882699 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f527b040-6328-454b-83fd-b5925df3da50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:52.883146 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f527b040-6328-454b-83fd-b5925df3da50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:52.883570 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f527b040-6328-454b-83fd-b5925df3da50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:53.041243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f527b040-6328-454b-83fd-b5925df3da50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:53.049230 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f527b040-6328-454b-83fd-b5925df3da50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.178737 Sep 19 17:23:53.065260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 43/87] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:52 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:53.583491 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:53.584139 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:53.593219 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:53.600737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:53.600737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:53.600737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:53.600737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:53.601089 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:53.734565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:53.742819 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:53.744302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:53.745409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4b22cda0-7156-49b8-b4f3-fdb47522c565 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.166806 Sep 19 17:23:53.746003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 45/88] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:53 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:53.874630 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c50c744b-ca86-415d-b77b-53805149fc79 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:53.875408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c50c744b-ca86-415d-b77b-53805149fc79 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:53.882402 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50c744b-ca86-415d-b77b-53805149fc79 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:53.882965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50c744b-ca86-415d-b77b-53805149fc79 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:53.883412 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50c744b-ca86-415d-b77b-53805149fc79 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:53.884136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50c744b-ca86-415d-b77b-53805149fc79 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:53.884594 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50c744b-ca86-415d-b77b-53805149fc79 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:53.885021 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50c744b-ca86-415d-b77b-53805149fc79 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:54.048157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c50c744b-ca86-415d-b77b-53805149fc79 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:54.048157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c50c744b-ca86-415d-b77b-53805149fc79 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.159286 Sep 19 17:23:54.048157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 44/89] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:53 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:54.072429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b283a51a-6a8e-4158-a3f6-3e028beb1504 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:54.081265 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b283a51a-6a8e-4158-a3f6-3e028beb1504 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:54.088995 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b283a51a-6a8e-4158-a3f6-3e028beb1504 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:54.089608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b283a51a-6a8e-4158-a3f6-3e028beb1504 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:54.090679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b283a51a-6a8e-4158-a3f6-3e028beb1504 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:54.091571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b283a51a-6a8e-4158-a3f6-3e028beb1504 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:54.092173 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b283a51a-6a8e-4158-a3f6-3e028beb1504 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:54.092715 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b283a51a-6a8e-4158-a3f6-3e028beb1504 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:54.248262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b283a51a-6a8e-4158-a3f6-3e028beb1504 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:54.256290 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b283a51a-6a8e-4158-a3f6-3e028beb1504 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.187919 Sep 19 17:23:54.256852 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 46/90] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:54 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:23:54.770677 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:54.771195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:54.778011 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:54.778487 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:54.778921 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:54.779602 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:54.780111 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:54.780532 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:54.910969 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:54.919994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:54.921473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:54.922568 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-071fbee2-bd6a-49f4-9528-db336ff81496 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.155936 Sep 19 17:23:54.923253 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 45/91] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:54 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:55.082341 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed9e85fd-8d8e-4742-8dab-c622c0a45077 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:55.082973 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed9e85fd-8d8e-4742-8dab-c622c0a45077 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:55.096350 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed9e85fd-8d8e-4742-8dab-c622c0a45077 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:55.097182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed9e85fd-8d8e-4742-8dab-c622c0a45077 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:55.099929 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed9e85fd-8d8e-4742-8dab-c622c0a45077 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:55.101364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed9e85fd-8d8e-4742-8dab-c622c0a45077 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:55.102067 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed9e85fd-8d8e-4742-8dab-c622c0a45077 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:55.102653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed9e85fd-8d8e-4742-8dab-c622c0a45077 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:55.256659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed9e85fd-8d8e-4742-8dab-c622c0a45077 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:55.264890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed9e85fd-8d8e-4742-8dab-c622c0a45077 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.192322 Sep 19 17:23:55.265464 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 47/92] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:55 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:55.278909 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dce39ab9-f2e7-4e49-9a9a-858012c47380 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:55.279481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dce39ab9-f2e7-4e49-9a9a-858012c47380 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:55.285805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dce39ab9-f2e7-4e49-9a9a-858012c47380 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:55.286296 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dce39ab9-f2e7-4e49-9a9a-858012c47380 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:55.286785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dce39ab9-f2e7-4e49-9a9a-858012c47380 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:55.287480 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dce39ab9-f2e7-4e49-9a9a-858012c47380 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:55.287976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dce39ab9-f2e7-4e49-9a9a-858012c47380 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:55.288406 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dce39ab9-f2e7-4e49-9a9a-858012c47380 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:55.459565 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-dce39ab9-f2e7-4e49-9a9a-858012c47380 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:55.468619 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dce39ab9-f2e7-4e49-9a9a-858012c47380 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.194150 Sep 19 17:23:55.469459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 46/93] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:55 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:55.953505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:55.961161 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:55.967449 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:55.968360 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:55.969724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:55.970888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:55.971504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:55.972104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:56.119086 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:56.131315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:56.138085 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:56.138085 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae0a6e5a-db41-4c43-bb89-a312c046e908 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.190385 Sep 19 17:23:56.138085 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 48/94] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:55 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:56.296399 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d4d9d95-e17a-485b-bf06-274eb89969c0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:56.297041 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d4d9d95-e17a-485b-bf06-274eb89969c0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:56.303336 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d4d9d95-e17a-485b-bf06-274eb89969c0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:56.303867 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d4d9d95-e17a-485b-bf06-274eb89969c0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:56.304310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d4d9d95-e17a-485b-bf06-274eb89969c0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:56.305011 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d4d9d95-e17a-485b-bf06-274eb89969c0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:56.305470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d4d9d95-e17a-485b-bf06-274eb89969c0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:56.305902 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d4d9d95-e17a-485b-bf06-274eb89969c0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:56.500621 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8bfec0ad-9efb-45e9-ac16-0320a55dd548 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:56.501242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8bfec0ad-9efb-45e9-ac16-0320a55dd548 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:56.517560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d4d9d95-e17a-485b-bf06-274eb89969c0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:56.519145 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfec0ad-9efb-45e9-ac16-0320a55dd548 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:56.519902 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfec0ad-9efb-45e9-ac16-0320a55dd548 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:56.520567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfec0ad-9efb-45e9-ac16-0320a55dd548 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:56.521768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfec0ad-9efb-45e9-ac16-0320a55dd548 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:56.524143 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfec0ad-9efb-45e9-ac16-0320a55dd548 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:56.524833 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfec0ad-9efb-45e9-ac16-0320a55dd548 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:56.525982 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d4d9d95-e17a-485b-bf06-274eb89969c0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.234095 Sep 19 17:23:56.527211 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 47/95] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:56 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:56.567060 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:56.706713 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8bfec0ad-9efb-45e9-ac16-0320a55dd548 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:56.714914 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8bfec0ad-9efb-45e9-ac16-0320a55dd548 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.223163 Sep 19 17:23:56.715503 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 49/96] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:56 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:23:57.159863 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:57.160511 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:57.166428 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:57.166933 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:57.167380 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:57.168808 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:57.169269 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:57.169704 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:57.483179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:57.493567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:57.495244 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:57.496701 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-737fbace-f517-4df9-b08b-f66cf8b0fdf7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.340852 Sep 19 17:23:57.497440 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 48/97] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:57 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:23:57.554197 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8119e30b-76e5-4a9b-aac8-dfbba5984f86 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:57.554790 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8119e30b-76e5-4a9b-aac8-dfbba5984f86 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:57.562270 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8119e30b-76e5-4a9b-aac8-dfbba5984f86 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:57.563087 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8119e30b-76e5-4a9b-aac8-dfbba5984f86 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:57.563848 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8119e30b-76e5-4a9b-aac8-dfbba5984f86 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:57.567888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8119e30b-76e5-4a9b-aac8-dfbba5984f86 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:57.567888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8119e30b-76e5-4a9b-aac8-dfbba5984f86 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:57.567888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8119e30b-76e5-4a9b-aac8-dfbba5984f86 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:57.738549 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-884282fe-a63e-4f5a-8569-e4dda4c06c84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:57.739549 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-884282fe-a63e-4f5a-8569-e4dda4c06c84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:57.747416 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-884282fe-a63e-4f5a-8569-e4dda4c06c84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:57.747941 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-884282fe-a63e-4f5a-8569-e4dda4c06c84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:57.749168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-884282fe-a63e-4f5a-8569-e4dda4c06c84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:57.750281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-884282fe-a63e-4f5a-8569-e4dda4c06c84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:57.750918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-884282fe-a63e-4f5a-8569-e4dda4c06c84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:57.751593 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-884282fe-a63e-4f5a-8569-e4dda4c06c84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:57.783144 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8119e30b-76e5-4a9b-aac8-dfbba5984f86 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:57.806212 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8119e30b-76e5-4a9b-aac8-dfbba5984f86 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.255128 Sep 19 17:23:57.806838 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 50/98] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:57 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:57.976329 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-884282fe-a63e-4f5a-8569-e4dda4c06c84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:57.985374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-884282fe-a63e-4f5a-8569-e4dda4c06c84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.251420 Sep 19 17:23:57.986136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 49/99] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:57 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:58.522714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:58.523334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:58.529921 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:58.530414 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:58.531064 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:58.531788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:58.532450 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:58.532884 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:58.682792 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:58.691352 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:58.692772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:58.693887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e85a3d2-bab5-431b-b34b-10b2d9adb387 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.175324 Sep 19 17:23:58.694452 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 51/100] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:58 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:23:58.833341 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98e67170-c160-4530-b79a-4b521f053e38 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:58.833341 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98e67170-c160-4530-b79a-4b521f053e38 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:58.841724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e67170-c160-4530-b79a-4b521f053e38 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:58.842577 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e67170-c160-4530-b79a-4b521f053e38 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:58.843171 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e67170-c160-4530-b79a-4b521f053e38 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:58.844473 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e67170-c160-4530-b79a-4b521f053e38 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:58.845185 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e67170-c160-4530-b79a-4b521f053e38 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:58.845761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e67170-c160-4530-b79a-4b521f053e38 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:58.955846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3875aa67-c4a4-4ab8-977c-7647d470b07c req-5070362e-4452-4229-8c18-2477fb6f41f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174c5ef6-abf1-465c-afed-96d456b50c8e", "name": "network-vif-plugged", "status": "completed", "tag": "95fe2876-ad84-4782-b5da-88dc57844f07"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:23:58.969938 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3875aa67-c4a4-4ab8-977c-7647d470b07c req-5070362e-4452-4229-8c18-2477fb6f41f9 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:58.970314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3875aa67-c4a4-4ab8-977c-7647d470b07c req-5070362e-4452-4229-8c18-2477fb6f41f9 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:58.970733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3875aa67-c4a4-4ab8-977c-7647d470b07c req-5070362e-4452-4229-8c18-2477fb6f41f9 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:59.003146 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3875aa67-c4a4-4ab8-977c-7647d470b07c req-5070362e-4452-4229-8c18-2477fb6f41f9 service nova] Creating event network-vif-plugged:95fe2876-ad84-4782-b5da-88dc57844f07 for instance 174c5ef6-abf1-465c-afed-96d456b50c8e on hv-cinder-84801 Sep 19 17:23:59.004731 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3875aa67-c4a4-4ab8-977c-7647d470b07c req-5070362e-4452-4229-8c18-2477fb6f41f9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 17:23:59.006405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3875aa67-c4a4-4ab8-977c-7647d470b07c req-5070362e-4452-4229-8c18-2477fb6f41f9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 17:23:59.010365 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b83db08a-7a32-4db2-a0ae-69db4c5716c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:59.017037 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b83db08a-7a32-4db2-a0ae-69db4c5716c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:59.017596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b83db08a-7a32-4db2-a0ae-69db4c5716c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:59.020029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b83db08a-7a32-4db2-a0ae-69db4c5716c6 None None] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:59.020820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b83db08a-7a32-4db2-a0ae-69db4c5716c6 None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:59.021531 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b83db08a-7a32-4db2-a0ae-69db4c5716c6 None None] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:59.045507 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.compute.rpcapi [None req-b83db08a-7a32-4db2-a0ae-69db4c5716c6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 17:23:59.047768 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b83db08a-7a32-4db2-a0ae-69db4c5716c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 17:23:59.055856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-98e67170-c160-4530-b79a-4b521f053e38 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:59.080603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b83db08a-7a32-4db2-a0ae-69db4c5716c6 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365553 Sep 19 17:23:59.080701 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98e67170-c160-4530-b79a-4b521f053e38 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.241626 Sep 19 17:23:59.080788 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 50/101] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:23:59.080869 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 52/102] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:58 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:59.085851 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c9d080d-1678-4350-aac1-c1e3a4d2989a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:59.086637 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c9d080d-1678-4350-aac1-c1e3a4d2989a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:59.093940 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c9d080d-1678-4350-aac1-c1e3a4d2989a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:59.094424 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c9d080d-1678-4350-aac1-c1e3a4d2989a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:59.095261 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c9d080d-1678-4350-aac1-c1e3a4d2989a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:59.095823 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c9d080d-1678-4350-aac1-c1e3a4d2989a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:59.096280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c9d080d-1678-4350-aac1-c1e3a4d2989a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:59.096709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c9d080d-1678-4350-aac1-c1e3a4d2989a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:59.102520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:59.293236 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c9d080d-1678-4350-aac1-c1e3a4d2989a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:59.302806 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c9d080d-1678-4350-aac1-c1e3a4d2989a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.232529 Sep 19 17:23:59.308233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 51/103] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:23:59 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:23:59.722088 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:23:59.722607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:23:59.729112 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:59.729635 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:59.730097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:59.731243 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:23:59.731944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:23:59.732369 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:23:59.877495 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:59.885685 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:59.887165 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:23:59.888347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8bc5b4b-62c8-4c25-b649-41fd7e4d58e5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.170982 Sep 19 17:23:59.889067 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 53/104] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:23:59 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:00.094689 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f522cf3e-e726-476a-9f9f-d6811e677610 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:00.095522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f522cf3e-e726-476a-9f9f-d6811e677610 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:00.103743 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f522cf3e-e726-476a-9f9f-d6811e677610 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:00.104276 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f522cf3e-e726-476a-9f9f-d6811e677610 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:00.104889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f522cf3e-e726-476a-9f9f-d6811e677610 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:00.106403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f522cf3e-e726-476a-9f9f-d6811e677610 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:00.107490 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f522cf3e-e726-476a-9f9f-d6811e677610 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:00.108174 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f522cf3e-e726-476a-9f9f-d6811e677610 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:00.255463 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f522cf3e-e726-476a-9f9f-d6811e677610 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:00.281413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f522cf3e-e726-476a-9f9f-d6811e677610 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.191375 Sep 19 17:24:00.299176 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 52/105] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:00 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:00.328629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fed8f13a-7e84-4594-afcc-f5e050cacc85 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:00.329330 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fed8f13a-7e84-4594-afcc-f5e050cacc85 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:00.341723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed8f13a-7e84-4594-afcc-f5e050cacc85 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:00.344159 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed8f13a-7e84-4594-afcc-f5e050cacc85 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:00.346618 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed8f13a-7e84-4594-afcc-f5e050cacc85 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:00.349223 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed8f13a-7e84-4594-afcc-f5e050cacc85 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:00.350860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed8f13a-7e84-4594-afcc-f5e050cacc85 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:00.352945 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed8f13a-7e84-4594-afcc-f5e050cacc85 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:00.630489 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fed8f13a-7e84-4594-afcc-f5e050cacc85 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:00.643560 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fed8f13a-7e84-4594-afcc-f5e050cacc85 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.320857 Sep 19 17:24:00.648610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 54/106] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:00 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:00.915348 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:00.915348 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:00.932714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:00.934003 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:00.935113 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:00.936221 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:00.936843 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:00.937989 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:01.107245 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:01.115631 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:01.117102 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:01.118247 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5438251-8d6f-4344-850a-7863ddfff984 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.208395 Sep 19 17:24:01.119007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 53/107] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:00 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:01.305148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bbbd0734-708a-496b-b8b3-b5b50e797ad6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:01.309252 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bbbd0734-708a-496b-b8b3-b5b50e797ad6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:01.314604 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbbd0734-708a-496b-b8b3-b5b50e797ad6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:01.315103 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbbd0734-708a-496b-b8b3-b5b50e797ad6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:01.315547 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbbd0734-708a-496b-b8b3-b5b50e797ad6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:01.316293 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbbd0734-708a-496b-b8b3-b5b50e797ad6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:01.317001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbbd0734-708a-496b-b8b3-b5b50e797ad6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:01.322091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbbd0734-708a-496b-b8b3-b5b50e797ad6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:01.591189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bbbd0734-708a-496b-b8b3-b5b50e797ad6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:01.600104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bbbd0734-708a-496b-b8b3-b5b50e797ad6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.298782 Sep 19 17:24:01.615339 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 55/108] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:01 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:01.671085 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6324b5f4-ccd0-4cb1-8943-e65d38ca7134 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:01.671757 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6324b5f4-ccd0-4cb1-8943-e65d38ca7134 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:01.683895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6324b5f4-ccd0-4cb1-8943-e65d38ca7134 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:01.683895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6324b5f4-ccd0-4cb1-8943-e65d38ca7134 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:01.683895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6324b5f4-ccd0-4cb1-8943-e65d38ca7134 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:01.683895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6324b5f4-ccd0-4cb1-8943-e65d38ca7134 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:01.684694 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6324b5f4-ccd0-4cb1-8943-e65d38ca7134 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:01.684694 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6324b5f4-ccd0-4cb1-8943-e65d38ca7134 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:01.868923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6324b5f4-ccd0-4cb1-8943-e65d38ca7134 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:01.882129 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6324b5f4-ccd0-4cb1-8943-e65d38ca7134 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.215057 Sep 19 17:24:01.883194 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 54/109] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:01 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:02.144414 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:02.145139 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:02.151401 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:02.151913 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:02.153090 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:02.153820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:02.154315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:02.154725 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:02.297157 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:02.307202 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:02.309349 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:02.310477 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0ed4aeae-e287-466a-9a11-6c0c9abb2b7d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.170367 Sep 19 17:24:02.311045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 56/110] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:02 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:02.624240 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-baeb9015-16d3-4eca-abff-a76ab053c6b7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:02.625037 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-baeb9015-16d3-4eca-abff-a76ab053c6b7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:02.631276 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-baeb9015-16d3-4eca-abff-a76ab053c6b7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:02.632079 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-baeb9015-16d3-4eca-abff-a76ab053c6b7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:02.632747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-baeb9015-16d3-4eca-abff-a76ab053c6b7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:02.633672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-baeb9015-16d3-4eca-abff-a76ab053c6b7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:02.634351 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-baeb9015-16d3-4eca-abff-a76ab053c6b7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:02.635229 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-baeb9015-16d3-4eca-abff-a76ab053c6b7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:02.824209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-baeb9015-16d3-4eca-abff-a76ab053c6b7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:02.833114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-baeb9015-16d3-4eca-abff-a76ab053c6b7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.213160 Sep 19 17:24:02.845135 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 55/111] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:02 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:02.906864 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-761560f8-a9bd-4aa9-be85-94fd8a804ecc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:02.907710 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-761560f8-a9bd-4aa9-be85-94fd8a804ecc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:02.913614 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-761560f8-a9bd-4aa9-be85-94fd8a804ecc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:02.914104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-761560f8-a9bd-4aa9-be85-94fd8a804ecc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:02.914545 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-761560f8-a9bd-4aa9-be85-94fd8a804ecc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:02.915240 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-761560f8-a9bd-4aa9-be85-94fd8a804ecc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:02.915722 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-761560f8-a9bd-4aa9-be85-94fd8a804ecc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:02.916156 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-761560f8-a9bd-4aa9-be85-94fd8a804ecc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:03.090143 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-761560f8-a9bd-4aa9-be85-94fd8a804ecc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:03.098938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-761560f8-a9bd-4aa9-be85-94fd8a804ecc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.196324 Sep 19 17:24:03.099621 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 57/112] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:02 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:03.340175 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:03.341205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:03.347751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:03.348449 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:03.349053 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:03.349897 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:03.350528 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:03.351123 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:03.503128 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:03.514494 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:03.516231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:03.517499 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc3800e0-a4c1-4793-9fc3-62a8b3db9b2c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.185164 Sep 19 17:24:03.518175 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 56/113] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:03 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:03.856267 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-321f53b2-7b02-488f-ac81-a6808e0c2042 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:03.856870 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-321f53b2-7b02-488f-ac81-a6808e0c2042 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:03.872075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321f53b2-7b02-488f-ac81-a6808e0c2042 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:03.872075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321f53b2-7b02-488f-ac81-a6808e0c2042 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:03.872075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321f53b2-7b02-488f-ac81-a6808e0c2042 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:03.872075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321f53b2-7b02-488f-ac81-a6808e0c2042 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:03.872414 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321f53b2-7b02-488f-ac81-a6808e0c2042 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:03.872414 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321f53b2-7b02-488f-ac81-a6808e0c2042 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:04.006833 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-321f53b2-7b02-488f-ac81-a6808e0c2042 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:04.015057 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-321f53b2-7b02-488f-ac81-a6808e0c2042 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.162755 Sep 19 17:24:04.015632 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 58/114] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:03 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:04.123189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7b275642-a7e6-4752-8434-809cbad65f0e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:04.123733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7b275642-a7e6-4752-8434-809cbad65f0e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:04.129736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b275642-a7e6-4752-8434-809cbad65f0e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:04.131987 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b275642-a7e6-4752-8434-809cbad65f0e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:04.131987 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b275642-a7e6-4752-8434-809cbad65f0e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:04.131987 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b275642-a7e6-4752-8434-809cbad65f0e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:04.131987 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b275642-a7e6-4752-8434-809cbad65f0e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:04.132465 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b275642-a7e6-4752-8434-809cbad65f0e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:04.289849 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7b275642-a7e6-4752-8434-809cbad65f0e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:04.298444 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7b275642-a7e6-4752-8434-809cbad65f0e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.179530 Sep 19 17:24:04.299925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 57/115] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:04 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:04.546137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:04.547057 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:04.555239 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:04.556033 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:04.556647 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:04.557617 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:04.558239 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:04.559020 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:04.739505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:04.751569 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:04.754486 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:04.755636 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f2c4510b-aa02-48f9-852f-96af47a2372d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.215827 Sep 19 17:24:04.768420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 59/116] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:04 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:05.037800 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-000ffe19-b1e0-40fe-a960-eaaa804f0546 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:05.038416 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-000ffe19-b1e0-40fe-a960-eaaa804f0546 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:05.049262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-000ffe19-b1e0-40fe-a960-eaaa804f0546 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:05.049262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-000ffe19-b1e0-40fe-a960-eaaa804f0546 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:05.049262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-000ffe19-b1e0-40fe-a960-eaaa804f0546 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:05.049262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-000ffe19-b1e0-40fe-a960-eaaa804f0546 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:05.049622 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-000ffe19-b1e0-40fe-a960-eaaa804f0546 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:05.049622 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-000ffe19-b1e0-40fe-a960-eaaa804f0546 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:05.186691 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-000ffe19-b1e0-40fe-a960-eaaa804f0546 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:05.194370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-000ffe19-b1e0-40fe-a960-eaaa804f0546 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.160420 Sep 19 17:24:05.194948 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 58/117] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:05 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:05.322055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e619b1d8-2797-4294-8c2a-36c544b15137 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:05.322681 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e619b1d8-2797-4294-8c2a-36c544b15137 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:05.329524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e619b1d8-2797-4294-8c2a-36c544b15137 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:05.330104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e619b1d8-2797-4294-8c2a-36c544b15137 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:05.330722 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e619b1d8-2797-4294-8c2a-36c544b15137 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:05.331476 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e619b1d8-2797-4294-8c2a-36c544b15137 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:05.332056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e619b1d8-2797-4294-8c2a-36c544b15137 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:05.332489 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e619b1d8-2797-4294-8c2a-36c544b15137 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:05.471115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e619b1d8-2797-4294-8c2a-36c544b15137 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:05.479035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e619b1d8-2797-4294-8c2a-36c544b15137 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.160995 Sep 19 17:24:05.479832 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 60/118] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:05 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:05.781178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:05.781994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:05.788065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:05.788546 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:05.789211 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:05.789970 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:05.790733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:05.791165 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:05.990928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:06.000238 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:06.002150 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:06.003478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d4ef6193-7615-4a14-8532-ba1d5599e519 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.226130 Sep 19 17:24:06.004363 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 59/119] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:05 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:06.219129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5351504b-56fd-47d6-829c-07c49abee133 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:06.219904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5351504b-56fd-47d6-829c-07c49abee133 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:06.226222 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5351504b-56fd-47d6-829c-07c49abee133 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:06.226706 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5351504b-56fd-47d6-829c-07c49abee133 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:06.227137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5351504b-56fd-47d6-829c-07c49abee133 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:06.227886 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5351504b-56fd-47d6-829c-07c49abee133 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:06.228341 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5351504b-56fd-47d6-829c-07c49abee133 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:06.228763 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5351504b-56fd-47d6-829c-07c49abee133 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:06.377593 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5351504b-56fd-47d6-829c-07c49abee133 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:06.389315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5351504b-56fd-47d6-829c-07c49abee133 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.174457 Sep 19 17:24:06.389897 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 61/120] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:06 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:06.503069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-13194a01-c21f-45be-a28c-cf9791f6f982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:06.505520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-13194a01-c21f-45be-a28c-cf9791f6f982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:06.511499 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13194a01-c21f-45be-a28c-cf9791f6f982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:06.511660 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13194a01-c21f-45be-a28c-cf9791f6f982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:06.512089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13194a01-c21f-45be-a28c-cf9791f6f982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:06.512787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13194a01-c21f-45be-a28c-cf9791f6f982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:06.513245 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13194a01-c21f-45be-a28c-cf9791f6f982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:06.513691 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13194a01-c21f-45be-a28c-cf9791f6f982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:06.669489 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-13194a01-c21f-45be-a28c-cf9791f6f982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:06.683255 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-13194a01-c21f-45be-a28c-cf9791f6f982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.184074 Sep 19 17:24:06.687126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 60/121] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:06 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:07.029970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:07.030587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:07.036652 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:07.037165 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:07.037605 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:07.038291 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:07.038749 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:07.039174 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:07.169231 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:07.178458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:07.181182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:07.181182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-954de522-61c1-456e-822a-20a420b96649 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.155542 Sep 19 17:24:07.181640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 62/122] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:07 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:07.413620 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b19eacac-70e6-4b99-868e-3f3afeda55f2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:07.414262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b19eacac-70e6-4b99-868e-3f3afeda55f2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:07.420244 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b19eacac-70e6-4b99-868e-3f3afeda55f2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:07.420895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b19eacac-70e6-4b99-868e-3f3afeda55f2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:07.421327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b19eacac-70e6-4b99-868e-3f3afeda55f2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:07.422014 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b19eacac-70e6-4b99-868e-3f3afeda55f2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:07.422467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b19eacac-70e6-4b99-868e-3f3afeda55f2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:07.423232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b19eacac-70e6-4b99-868e-3f3afeda55f2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:07.555228 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b19eacac-70e6-4b99-868e-3f3afeda55f2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:07.563491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b19eacac-70e6-4b99-868e-3f3afeda55f2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.154113 Sep 19 17:24:07.564172 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 61/123] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:07 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:07.710307 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89a37ed2-c10c-4a65-9212-6f59ed905976 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:07.711305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89a37ed2-c10c-4a65-9212-6f59ed905976 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:07.717801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a37ed2-c10c-4a65-9212-6f59ed905976 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:07.718298 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a37ed2-c10c-4a65-9212-6f59ed905976 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:07.718734 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a37ed2-c10c-4a65-9212-6f59ed905976 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:07.719436 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a37ed2-c10c-4a65-9212-6f59ed905976 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:07.719949 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a37ed2-c10c-4a65-9212-6f59ed905976 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:07.720379 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a37ed2-c10c-4a65-9212-6f59ed905976 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:07.877468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-89a37ed2-c10c-4a65-9212-6f59ed905976 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:07.885508 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89a37ed2-c10c-4a65-9212-6f59ed905976 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.179254 Sep 19 17:24:07.886095 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 63/124] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:07 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:08.205066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:08.205677 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:08.211664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:08.212180 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:08.212622 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:08.213327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:08.213785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:08.214216 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:08.349422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:08.358568 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:08.360060 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:08.361188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99d4d8a2-e185-4690-9aff-e938e036253d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.160172 Sep 19 17:24:08.361752 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 62/125] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:08 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:08.590743 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5cacff96-319c-4bdd-b60f-ed25dabc0fca tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:08.591358 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5cacff96-319c-4bdd-b60f-ed25dabc0fca tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:08.597226 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cacff96-319c-4bdd-b60f-ed25dabc0fca tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:08.597720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cacff96-319c-4bdd-b60f-ed25dabc0fca tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:08.598160 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cacff96-319c-4bdd-b60f-ed25dabc0fca tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:08.598855 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cacff96-319c-4bdd-b60f-ed25dabc0fca tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:08.599870 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cacff96-319c-4bdd-b60f-ed25dabc0fca tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:08.600169 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cacff96-319c-4bdd-b60f-ed25dabc0fca tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:08.736472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5cacff96-319c-4bdd-b60f-ed25dabc0fca tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:08.745773 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5cacff96-319c-4bdd-b60f-ed25dabc0fca tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.159198 Sep 19 17:24:08.746331 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 64/126] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:08 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:08.916813 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5ee215b5-a2f1-4ac1-acd6-abaca8cd1a31 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:08.917453 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5ee215b5-a2f1-4ac1-acd6-abaca8cd1a31 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:08.923334 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ee215b5-a2f1-4ac1-acd6-abaca8cd1a31 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:08.923959 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ee215b5-a2f1-4ac1-acd6-abaca8cd1a31 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:08.924321 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ee215b5-a2f1-4ac1-acd6-abaca8cd1a31 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:08.925031 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ee215b5-a2f1-4ac1-acd6-abaca8cd1a31 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:08.927733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ee215b5-a2f1-4ac1-acd6-abaca8cd1a31 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:08.927733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ee215b5-a2f1-4ac1-acd6-abaca8cd1a31 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:09.044622 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:09.071163 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5ee215b5-a2f1-4ac1-acd6-abaca8cd1a31 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:09.081637 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5ee215b5-a2f1-4ac1-acd6-abaca8cd1a31 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.168321 Sep 19 17:24:09.082944 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 63/127] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:08 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:09.387016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:09.387675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:09.394016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:09.394429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:09.394994 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:09.395546 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:09.396282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:09.396706 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:09.544399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:09.553473 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:09.554937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:09.556126 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f73fb9b4-7c93-484a-a54c-0d7c53e7a0c0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.173933 Sep 19 17:24:09.556712 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 65/128] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:09 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:24:09.770164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ff5bf917-50ae-4c27-aca1-87f0793d02f0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:09.771061 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ff5bf917-50ae-4c27-aca1-87f0793d02f0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:09.780474 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff5bf917-50ae-4c27-aca1-87f0793d02f0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:09.781201 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff5bf917-50ae-4c27-aca1-87f0793d02f0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:09.783014 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff5bf917-50ae-4c27-aca1-87f0793d02f0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:09.783014 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff5bf917-50ae-4c27-aca1-87f0793d02f0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:09.783291 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff5bf917-50ae-4c27-aca1-87f0793d02f0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:09.783904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff5bf917-50ae-4c27-aca1-87f0793d02f0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:09.922969 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ff5bf917-50ae-4c27-aca1-87f0793d02f0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:09.931874 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ff5bf917-50ae-4c27-aca1-87f0793d02f0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.165793 Sep 19 17:24:09.932448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 64/129] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:09 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:10.106169 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be8401bc-ec86-468d-8595-327ea4de9c28 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:10.106775 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be8401bc-ec86-468d-8595-327ea4de9c28 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:10.112905 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8401bc-ec86-468d-8595-327ea4de9c28 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:10.113386 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8401bc-ec86-468d-8595-327ea4de9c28 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:10.113820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8401bc-ec86-468d-8595-327ea4de9c28 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:10.114502 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8401bc-ec86-468d-8595-327ea4de9c28 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:10.114962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8401bc-ec86-468d-8595-327ea4de9c28 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:10.115461 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8401bc-ec86-468d-8595-327ea4de9c28 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:10.119610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:10.245372 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-be8401bc-ec86-468d-8595-327ea4de9c28 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:10.255606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be8401bc-ec86-468d-8595-327ea4de9c28 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.154017 Sep 19 17:24:10.262372 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 66/130] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:10 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:10.581536 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:10.582149 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:10.588075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:10.588560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:10.588997 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:10.589683 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:10.590141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:10.590563 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:10.723403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:10.731650 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:10.733095 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:10.734430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-08dd6def-99df-4d9f-a8dd-03d48f248572 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.156581 Sep 19 17:24:10.735108 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 65/131] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:10 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:10.954749 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6ec93a83-28d7-4400-960c-706f7094810c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:10.955412 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6ec93a83-28d7-4400-960c-706f7094810c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:10.963955 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec93a83-28d7-4400-960c-706f7094810c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:10.964483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec93a83-28d7-4400-960c-706f7094810c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:10.965179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec93a83-28d7-4400-960c-706f7094810c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:10.965776 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec93a83-28d7-4400-960c-706f7094810c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:10.966240 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec93a83-28d7-4400-960c-706f7094810c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:10.966677 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec93a83-28d7-4400-960c-706f7094810c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:11.095254 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ec93a83-28d7-4400-960c-706f7094810c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:11.102969 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6ec93a83-28d7-4400-960c-706f7094810c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.152146 Sep 19 17:24:11.115939 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 67/132] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:10 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:11.279950 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e7d8bf44-42de-4158-b119-a41b6cf00795 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:11.280564 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e7d8bf44-42de-4158-b119-a41b6cf00795 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:11.286869 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8bf44-42de-4158-b119-a41b6cf00795 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:11.287529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8bf44-42de-4158-b119-a41b6cf00795 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:11.288053 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8bf44-42de-4158-b119-a41b6cf00795 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:11.288747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8bf44-42de-4158-b119-a41b6cf00795 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:11.289204 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8bf44-42de-4158-b119-a41b6cf00795 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:11.289631 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8bf44-42de-4158-b119-a41b6cf00795 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:11.500157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e7d8bf44-42de-4158-b119-a41b6cf00795 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:11.508080 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e7d8bf44-42de-4158-b119-a41b6cf00795 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.232528 Sep 19 17:24:11.508681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 66/133] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:11 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:11.760698 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:11.761701 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:11.767423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:11.767974 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:11.768406 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:11.769088 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:11.769536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:11.769950 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:11.919279 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:11.927311 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:11.929508 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:11.930621 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54687b09-71b6-4781-b657-3027c65edb8f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.173869 Sep 19 17:24:11.931177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 68/134] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:11 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:12.126890 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53c29cd6-0695-454b-97b8-5b448092440c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:12.127495 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53c29cd6-0695-454b-97b8-5b448092440c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:12.133673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c29cd6-0695-454b-97b8-5b448092440c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:12.134150 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c29cd6-0695-454b-97b8-5b448092440c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:12.134582 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c29cd6-0695-454b-97b8-5b448092440c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:12.135263 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c29cd6-0695-454b-97b8-5b448092440c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:12.135731 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c29cd6-0695-454b-97b8-5b448092440c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:12.136965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c29cd6-0695-454b-97b8-5b448092440c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:12.272922 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-53c29cd6-0695-454b-97b8-5b448092440c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:12.276488 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:12.281377 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53c29cd6-0695-454b-97b8-5b448092440c tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.158448 Sep 19 17:24:12.281948 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 67/135] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:12 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:12.531480 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d633ede1-6352-4287-a896-52afd6e83fb6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:12.538965 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d633ede1-6352-4287-a896-52afd6e83fb6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:12.538965 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d633ede1-6352-4287-a896-52afd6e83fb6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:12.538965 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d633ede1-6352-4287-a896-52afd6e83fb6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:12.539689 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d633ede1-6352-4287-a896-52afd6e83fb6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:12.540407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d633ede1-6352-4287-a896-52afd6e83fb6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:12.540861 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d633ede1-6352-4287-a896-52afd6e83fb6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:12.541283 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d633ede1-6352-4287-a896-52afd6e83fb6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:12.680299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d633ede1-6352-4287-a896-52afd6e83fb6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:12.689247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d633ede1-6352-4287-a896-52afd6e83fb6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.162503 Sep 19 17:24:12.689833 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 69/136] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:12 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:12.956317 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:12.956952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:12.963262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:12.963770 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:12.964734 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:12.965625 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:12.965887 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:12.966971 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:13.124879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:13.134695 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:13.137837 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:13.139865 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-59784eaa-c3f0-4b3e-a497-81279e3a8f4e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.187757 Sep 19 17:24:13.152287 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 68/137] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:12 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:13.305048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-90bdbc14-300e-4032-bdc2-3b565ad7694d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:13.305667 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-90bdbc14-300e-4032-bdc2-3b565ad7694d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:13.312013 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90bdbc14-300e-4032-bdc2-3b565ad7694d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:13.315015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90bdbc14-300e-4032-bdc2-3b565ad7694d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:13.315015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90bdbc14-300e-4032-bdc2-3b565ad7694d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:13.315015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90bdbc14-300e-4032-bdc2-3b565ad7694d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:13.315015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90bdbc14-300e-4032-bdc2-3b565ad7694d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:13.315571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90bdbc14-300e-4032-bdc2-3b565ad7694d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:13.533723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-90bdbc14-300e-4032-bdc2-3b565ad7694d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:13.544564 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-90bdbc14-300e-4032-bdc2-3b565ad7694d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.240963 Sep 19 17:24:13.553476 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 70/138] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:13 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:13.731804 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bb277f70-28a2-446f-b1f6-6f0b5babbb67 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:13.733871 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bb277f70-28a2-446f-b1f6-6f0b5babbb67 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:13.747933 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb277f70-28a2-446f-b1f6-6f0b5babbb67 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:13.757623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb277f70-28a2-446f-b1f6-6f0b5babbb67 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:13.757623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb277f70-28a2-446f-b1f6-6f0b5babbb67 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:13.757623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb277f70-28a2-446f-b1f6-6f0b5babbb67 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:13.757623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb277f70-28a2-446f-b1f6-6f0b5babbb67 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:13.758117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb277f70-28a2-446f-b1f6-6f0b5babbb67 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:13.867738 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-1d98e40f-85b8-4186-af55-87327627c2f9 req-e64b011a-c431-46e3-b6e7-6b9a2877c6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c05ebb-0e1d-4420-b50a-c289b41715da", "name": "network-vif-plugged", "status": "completed", "tag": "9d69013e-49a8-47b6-be21-f1203cc13ade"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:24:13.895893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1d98e40f-85b8-4186-af55-87327627c2f9 req-e64b011a-c431-46e3-b6e7-6b9a2877c6c8 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:13.896440 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1d98e40f-85b8-4186-af55-87327627c2f9 req-e64b011a-c431-46e3-b6e7-6b9a2877c6c8 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:13.897054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1d98e40f-85b8-4186-af55-87327627c2f9 req-e64b011a-c431-46e3-b6e7-6b9a2877c6c8 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:13.932036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-1d98e40f-85b8-4186-af55-87327627c2f9 req-e64b011a-c431-46e3-b6e7-6b9a2877c6c8 service nova] Creating event network-vif-plugged:9d69013e-49a8-47b6-be21-f1203cc13ade for instance 16c05ebb-0e1d-4420-b50a-c289b41715da on hv-cinder-84801 Sep 19 17:24:13.943070 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-1d98e40f-85b8-4186-af55-87327627c2f9 req-e64b011a-c431-46e3-b6e7-6b9a2877c6c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079838 Sep 19 17:24:13.944512 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 71/139] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:24:13.988361 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bb277f70-28a2-446f-b1f6-6f0b5babbb67 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:14.000680 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bb277f70-28a2-446f-b1f6-6f0b5babbb67 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.290716 Sep 19 17:24:14.013596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 69/140] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:13 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:14.173593 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:14.174293 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:14.184301 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:14.184796 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:14.185230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:14.185932 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:14.186384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:14.186805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:14.345438 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:14.355734 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:14.357863 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:14.359662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd696868-23ad-4118-b574-7bd20ebd4eae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.189966 Sep 19 17:24:14.373985 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 72/141] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:14 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:14.582154 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e8d1ca8d-b402-4f94-a70e-a9e78a4b5fa7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:14.583011 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e8d1ca8d-b402-4f94-a70e-a9e78a4b5fa7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:14.592385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8d1ca8d-b402-4f94-a70e-a9e78a4b5fa7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:14.593136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8d1ca8d-b402-4f94-a70e-a9e78a4b5fa7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:14.593864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8d1ca8d-b402-4f94-a70e-a9e78a4b5fa7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:14.594611 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8d1ca8d-b402-4f94-a70e-a9e78a4b5fa7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:14.595077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8d1ca8d-b402-4f94-a70e-a9e78a4b5fa7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:14.595514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8d1ca8d-b402-4f94-a70e-a9e78a4b5fa7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:14.795305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8d1ca8d-b402-4f94-a70e-a9e78a4b5fa7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:14.805065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e8d1ca8d-b402-4f94-a70e-a9e78a4b5fa7 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1314 microversion: 2.1 time: 0.227012 Sep 19 17:24:14.805793 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 70/142] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:14 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:15.029788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-605ccb83-0a66-49c9-a2a2-05d429066748 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:15.031185 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-605ccb83-0a66-49c9-a2a2-05d429066748 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:15.044096 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605ccb83-0a66-49c9-a2a2-05d429066748 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:15.067128 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605ccb83-0a66-49c9-a2a2-05d429066748 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:15.067128 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605ccb83-0a66-49c9-a2a2-05d429066748 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:15.067128 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605ccb83-0a66-49c9-a2a2-05d429066748 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:15.067128 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605ccb83-0a66-49c9-a2a2-05d429066748 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:15.067518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605ccb83-0a66-49c9-a2a2-05d429066748 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:15.336967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-605ccb83-0a66-49c9-a2a2-05d429066748 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:15.345986 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-605ccb83-0a66-49c9-a2a2-05d429066748 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.321194 Sep 19 17:24:15.346945 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 73/143] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:15 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:15.385455 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:15.387096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:15.393390 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:15.394414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:15.395027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:15.396303 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:15.397280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:15.397795 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:15.566048 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:15.574702 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:15.576201 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:15.577307 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9d797728-9431-4aa8-bc42-bc1a8c6732af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.195965 Sep 19 17:24:15.581406 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 71/144] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:15 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:15.828727 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2652cdd5-1e98-4cc2-887d-f652411bd3cc tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:15.831675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2652cdd5-1e98-4cc2-887d-f652411bd3cc tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:15.831675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=79 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:15.836569 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2652cdd5-1e98-4cc2-887d-f652411bd3cc tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:15.837047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2652cdd5-1e98-4cc2-887d-f652411bd3cc tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:15.837475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2652cdd5-1e98-4cc2-887d-f652411bd3cc tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:15.838328 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2652cdd5-1e98-4cc2-887d-f652411bd3cc tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:15.838777 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2652cdd5-1e98-4cc2-887d-f652411bd3cc tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:15.839713 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2652cdd5-1e98-4cc2-887d-f652411bd3cc tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:15.959222 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a58361d8-1022-4285-a7c3-18efa0666111 req-6495b598-179e-41d9-b7fa-ddf0ee369c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f141f191-3cdc-4eef-8f61-bea738735537", "name": "network-vif-plugged", "status": "completed", "tag": "e5a3c33b-3371-42fa-9473-41736f479159"}, {"server_uuid": "8d2eb485-3b5a-4326-bd4f-9029da4e6744", "name": "network-vif-plugged", "status": "completed", "tag": "e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:24:15.971839 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a58361d8-1022-4285-a7c3-18efa0666111 req-6495b598-179e-41d9-b7fa-ddf0ee369c92 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:15.972753 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a58361d8-1022-4285-a7c3-18efa0666111 req-6495b598-179e-41d9-b7fa-ddf0ee369c92 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:15.973377 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a58361d8-1022-4285-a7c3-18efa0666111 req-6495b598-179e-41d9-b7fa-ddf0ee369c92 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:15.986606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2652cdd5-1e98-4cc2-887d-f652411bd3cc tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:15.992984 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a58361d8-1022-4285-a7c3-18efa0666111 req-6495b598-179e-41d9-b7fa-ddf0ee369c92 service nova] Creating event network-vif-plugged:e5a3c33b-3371-42fa-9473-41736f479159 for instance f141f191-3cdc-4eef-8f61-bea738735537 on hv-cinder-84801 Sep 19 17:24:16.002960 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a58361d8-1022-4285-a7c3-18efa0666111 req-6495b598-179e-41d9-b7fa-ddf0ee369c92 service nova] Creating event network-vif-plugged:e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43 for instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 on hv-cinder-84801 Sep 19 17:24:16.003638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2652cdd5-1e98-4cc2-887d-f652411bd3cc tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1501 microversion: 2.1 time: 0.173224 Sep 19 17:24:16.003965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a58361d8-1022-4285-a7c3-18efa0666111 req-6495b598-179e-41d9-b7fa-ddf0ee369c92 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045562 Sep 19 17:24:16.004053 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 74/145] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:15 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:16.004136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 72/146] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:24:16.370428 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-747a33d1-a0b2-4730-b551-b842885852c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:16.372056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-747a33d1-a0b2-4730-b551-b842885852c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:16.377768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-747a33d1-a0b2-4730-b551-b842885852c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:16.378258 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-747a33d1-a0b2-4730-b551-b842885852c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:16.378696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-747a33d1-a0b2-4730-b551-b842885852c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:16.379389 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-747a33d1-a0b2-4730-b551-b842885852c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:16.379881 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-747a33d1-a0b2-4730-b551-b842885852c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:16.380311 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-747a33d1-a0b2-4730-b551-b842885852c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:16.616046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:16.617383 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:16.651505 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:16.652873 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:16.653666 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:16.654934 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:16.657365 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:16.664968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-747a33d1-a0b2-4730-b551-b842885852c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:16.667526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:16.675856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-747a33d1-a0b2-4730-b551-b842885852c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.309700 Sep 19 17:24:16.677573 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 75/147] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:16 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:16.914379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:16.928103 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:16.929918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:16.931278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c79b4294-4fc7-48fa-acbb-ebd200a5d51a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.331008 Sep 19 17:24:16.932140 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 73/148] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:16 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:24:17.723451 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29249f0e-06ec-4320-a2b4-6cf1d1938c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:17.724095 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-29249f0e-06ec-4320-a2b4-6cf1d1938c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:17.730361 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29249f0e-06ec-4320-a2b4-6cf1d1938c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:17.731327 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29249f0e-06ec-4320-a2b4-6cf1d1938c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:17.732074 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29249f0e-06ec-4320-a2b4-6cf1d1938c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:17.732963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29249f0e-06ec-4320-a2b4-6cf1d1938c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:17.733773 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29249f0e-06ec-4320-a2b4-6cf1d1938c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:17.734751 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29249f0e-06ec-4320-a2b4-6cf1d1938c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:17.958411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:17.959079 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:17.980040 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:17.981436 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:17.982117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:17.983345 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:17.984091 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:17.984896 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:18.093312 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-29249f0e-06ec-4320-a2b4-6cf1d1938c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:18.102176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29249f0e-06ec-4320-a2b4-6cf1d1938c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.382482 Sep 19 17:24:18.103572 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 76/149] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:17 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:18.195288 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:18.203996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:18.205455 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:18.206569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2cf7159-fb55-47ac-8ba2-27f459340eed tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.252868 Sep 19 17:24:18.207160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 74/150] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:17 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:24:19.115140 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-46ef715a-ca3a-43f3-894e-5beae4c22f10 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42fe972c-01d4-4893-8cf8-7cfb8fda670c"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:24:19.117764 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-46ef715a-ca3a-43f3-894e-5beae4c22f10 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:19.125365 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46ef715a-ca3a-43f3-894e-5beae4c22f10 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:19.125862 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46ef715a-ca3a-43f3-894e-5beae4c22f10 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:19.126325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46ef715a-ca3a-43f3-894e-5beae4c22f10 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:19.127141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46ef715a-ca3a-43f3-894e-5beae4c22f10 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:19.127608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46ef715a-ca3a-43f3-894e-5beae4c22f10 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:19.128046 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46ef715a-ca3a-43f3-894e-5beae4c22f10 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:19.129258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d71c2cb4-d38b-4aa0-b1a8-7943f0e33a0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:19.130581 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d71c2cb4-d38b-4aa0-b1a8-7943f0e33a0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:19.138827 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d71c2cb4-d38b-4aa0-b1a8-7943f0e33a0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:19.139325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d71c2cb4-d38b-4aa0-b1a8-7943f0e33a0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:19.139804 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d71c2cb4-d38b-4aa0-b1a8-7943f0e33a0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:19.140558 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d71c2cb4-d38b-4aa0-b1a8-7943f0e33a0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:19.141001 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d71c2cb4-d38b-4aa0-b1a8-7943f0e33a0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:19.144695 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d71c2cb4-d38b-4aa0-b1a8-7943f0e33a0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:19.332007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d71c2cb4-d38b-4aa0-b1a8-7943f0e33a0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:19.342470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d71c2cb4-d38b-4aa0-b1a8-7943f0e33a0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.219299 Sep 19 17:24:19.343066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 75/151] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:19 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:19.348071 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:19.348705 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:19.355150 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:19.355640 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:19.356101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:19.356799 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:19.357248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:19.357846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:19.524859 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:19.535817 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:19.540327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:19.541640 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4bf34851-7058-4197-a5d6-b33b2e31415e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.197638 Sep 19 17:24:19.542345 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 76/152] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:19 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:20.416075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d596354-6897-44ec-8dac-00b54efbcb3b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:20.416075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7d596354-6897-44ec-8dac-00b54efbcb3b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:20.416075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d596354-6897-44ec-8dac-00b54efbcb3b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:20.416075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d596354-6897-44ec-8dac-00b54efbcb3b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:20.418592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d596354-6897-44ec-8dac-00b54efbcb3b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:20.418592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d596354-6897-44ec-8dac-00b54efbcb3b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:20.418592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d596354-6897-44ec-8dac-00b54efbcb3b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:20.418592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d596354-6897-44ec-8dac-00b54efbcb3b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:20.512721 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7d596354-6897-44ec-8dac-00b54efbcb3b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:20.520952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d596354-6897-44ec-8dac-00b54efbcb3b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1321 microversion: 2.1 time: 0.155085 Sep 19 17:24:20.521519 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 77/153] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:20 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:20.592096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:20.592096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:20.592096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:20.592096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:20.592705 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:20.592705 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:20.592705 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:20.592705 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:20.721301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:20.729344 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:20.730693 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:20.731847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-32649022-dd8f-41f8-81ac-43ff367ea205 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1406 microversion: 2.20 time: 0.168824 Sep 19 17:24:20.732359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 78/154] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:20 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:24:21.549066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-740ed0bf-df94-4bc5-966e-eaab4c9312f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:21.550652 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-740ed0bf-df94-4bc5-966e-eaab4c9312f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:21.558544 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-740ed0bf-df94-4bc5-966e-eaab4c9312f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:21.559318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-740ed0bf-df94-4bc5-966e-eaab4c9312f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:21.560348 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-740ed0bf-df94-4bc5-966e-eaab4c9312f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:21.561344 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-740ed0bf-df94-4bc5-966e-eaab4c9312f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:21.561907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-740ed0bf-df94-4bc5-966e-eaab4c9312f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:21.562443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-740ed0bf-df94-4bc5-966e-eaab4c9312f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:21.746003 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-740ed0bf-df94-4bc5-966e-eaab4c9312f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:21.754013 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-740ed0bf-df94-4bc5-966e-eaab4c9312f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1515 microversion: 2.1 time: 0.209481 Sep 19 17:24:21.754584 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 79/155] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:21 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:21.758981 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:21.759580 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:21.765973 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:21.766686 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:21.767327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:21.768395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:21.769075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:21.769681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:21.967211 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:21.975733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:21.977190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:21.978355 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7ab512d1-ba68-42ed-bf90-20c49d03262b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1597 microversion: 2.20 time: 0.222861 Sep 19 17:24:21.979873 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 80/156] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:24:21 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1597 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:24:21.989825 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ebdbec52-dbe6-4376-af50-73ab0123d854 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:24:21.992817 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ebdbec52-dbe6-4376-af50-73ab0123d854 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:22.000202 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebdbec52-dbe6-4376-af50-73ab0123d854 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:22.000700 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebdbec52-dbe6-4376-af50-73ab0123d854 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:22.001147 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebdbec52-dbe6-4376-af50-73ab0123d854 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:22.001890 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebdbec52-dbe6-4376-af50-73ab0123d854 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:22.002557 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebdbec52-dbe6-4376-af50-73ab0123d854 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:22.002992 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebdbec52-dbe6-4376-af50-73ab0123d854 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:22.075217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-ebdbec52-dbe6-4376-af50-73ab0123d854 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lazy-loading 'flavor' on Instance uuid f141f191-3cdc-4eef-8f61-bea738735537 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:24:22.468986 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ebdbec52-dbe6-4376-af50-73ab0123d854 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "POST /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537/action" status: 200 len: 32 microversion: 2.1 time: 0.487773 Sep 19 17:24:22.469522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 81/157] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:24:21 2022] POST /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537/action => generated 32 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 17:24:22.474591 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-08ff75ff-5583-47f4-a1e6-2ffd89167245 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:22.475155 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-08ff75ff-5583-47f4-a1e6-2ffd89167245 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:22.481227 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08ff75ff-5583-47f4-a1e6-2ffd89167245 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:22.481706 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08ff75ff-5583-47f4-a1e6-2ffd89167245 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:22.482139 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08ff75ff-5583-47f4-a1e6-2ffd89167245 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:22.482830 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08ff75ff-5583-47f4-a1e6-2ffd89167245 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:22.483281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08ff75ff-5583-47f4-a1e6-2ffd89167245 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:22.483764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08ff75ff-5583-47f4-a1e6-2ffd89167245 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:22.600590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-08ff75ff-5583-47f4-a1e6-2ffd89167245 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.129853 Sep 19 17:24:22.601414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 82/158] 10.222.0.61 () {60 vars in 1316 bytes} [Mon Sep 19 17:24:22 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:24:22.606188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4afb778a-c549-4a6d-b4a2-994dde09f5cb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:22.606887 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4afb778a-c549-4a6d-b4a2-994dde09f5cb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:22.613331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4afb778a-c549-4a6d-b4a2-994dde09f5cb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:22.613812 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4afb778a-c549-4a6d-b4a2-994dde09f5cb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:22.614283 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4afb778a-c549-4a6d-b4a2-994dde09f5cb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:22.614932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4afb778a-c549-4a6d-b4a2-994dde09f5cb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:22.615402 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4afb778a-c549-4a6d-b4a2-994dde09f5cb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:22.623982 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4afb778a-c549-4a6d-b4a2-994dde09f5cb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:22.649605 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:22.735927 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-46ef715a-ca3a-43f3-894e-5beae4c22f10 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "POST /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.624592 Sep 19 17:24:22.737431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 77/159] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:24:19 2022] POST /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e/os-volume_attachments => generated 194 bytes in 3627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:24:22.815717 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4afb778a-c549-4a6d-b4a2-994dde09f5cb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:22.829513 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4afb778a-c549-4a6d-b4a2-994dde09f5cb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.226660 Sep 19 17:24:22.831478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 83/160] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:22 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:23.863678 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7d7d90c2-e7f6-45c7-b060-ea38bb4a9982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:23.864330 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7d7d90c2-e7f6-45c7-b060-ea38bb4a9982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:23.871017 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d7d90c2-e7f6-45c7-b060-ea38bb4a9982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:23.871579 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d7d90c2-e7f6-45c7-b060-ea38bb4a9982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:23.872042 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d7d90c2-e7f6-45c7-b060-ea38bb4a9982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:23.872903 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d7d90c2-e7f6-45c7-b060-ea38bb4a9982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:23.873646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d7d90c2-e7f6-45c7-b060-ea38bb4a9982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:23.874384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d7d90c2-e7f6-45c7-b060-ea38bb4a9982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:24.220625 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7d7d90c2-e7f6-45c7-b060-ea38bb4a9982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:24.229805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7d7d90c2-e7f6-45c7-b060-ea38bb4a9982 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.379097 Sep 19 17:24:24.230972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 78/161] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:23 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:25.200614 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5340d2ef-d21b-4583-aed4-d24575d8a961 req-682a4c96-4b93-429f-ac7b-02b5c8072966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2eb485-3b5a-4326-bd4f-9029da4e6744", "tag": "e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:24:25.214798 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=86 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:25.224494 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5340d2ef-d21b-4583-aed4-d24575d8a961 req-682a4c96-4b93-429f-ac7b-02b5c8072966 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:25.225408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5340d2ef-d21b-4583-aed4-d24575d8a961 req-682a4c96-4b93-429f-ac7b-02b5c8072966 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:25.225840 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5340d2ef-d21b-4583-aed4-d24575d8a961 req-682a4c96-4b93-429f-ac7b-02b5c8072966 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:25.238006 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-5340d2ef-d21b-4583-aed4-d24575d8a961 req-682a4c96-4b93-429f-ac7b-02b5c8072966 service nova] Creating event network-changed:e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43 for instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 on hv-cinder-84801 Sep 19 17:24:25.243374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5340d2ef-d21b-4583-aed4-d24575d8a961 req-682a4c96-4b93-429f-ac7b-02b5c8072966 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053487 Sep 19 17:24:25.244540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 84/162] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:24:25.255056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3c83b4a-b41c-4c6d-9bdc-c6b3a0e56a2d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:25.256334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3c83b4a-b41c-4c6d-9bdc-c6b3a0e56a2d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:25.266108 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3c83b4a-b41c-4c6d-9bdc-c6b3a0e56a2d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:25.268042 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3c83b4a-b41c-4c6d-9bdc-c6b3a0e56a2d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:25.270072 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3c83b4a-b41c-4c6d-9bdc-c6b3a0e56a2d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:25.271532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3c83b4a-b41c-4c6d-9bdc-c6b3a0e56a2d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:25.272192 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3c83b4a-b41c-4c6d-9bdc-c6b3a0e56a2d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:25.272797 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3c83b4a-b41c-4c6d-9bdc-c6b3a0e56a2d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:25.438506 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3c83b4a-b41c-4c6d-9bdc-c6b3a0e56a2d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:25.446933 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3c83b4a-b41c-4c6d-9bdc-c6b3a0e56a2d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.196459 Sep 19 17:24:25.447616 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 79/163] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:25 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:26.476178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1f4382e1-6a43-4634-b842-e68700a9e8f6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:26.477528 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1f4382e1-6a43-4634-b842-e68700a9e8f6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:26.486779 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f4382e1-6a43-4634-b842-e68700a9e8f6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:26.488276 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f4382e1-6a43-4634-b842-e68700a9e8f6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:26.488900 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f4382e1-6a43-4634-b842-e68700a9e8f6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:26.490007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f4382e1-6a43-4634-b842-e68700a9e8f6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:26.490676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f4382e1-6a43-4634-b842-e68700a9e8f6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:26.491262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f4382e1-6a43-4634-b842-e68700a9e8f6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:26.629901 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f4382e1-6a43-4634-b842-e68700a9e8f6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:26.650711 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1f4382e1-6a43-4634-b842-e68700a9e8f6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.183914 Sep 19 17:24:26.651587 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 85/164] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:26 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:27.674372 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-000a049e-2c1b-4022-a9c2-bc5adf3be888 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:27.674976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-000a049e-2c1b-4022-a9c2-bc5adf3be888 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:27.681626 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-000a049e-2c1b-4022-a9c2-bc5adf3be888 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:27.682260 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-000a049e-2c1b-4022-a9c2-bc5adf3be888 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:27.682708 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-000a049e-2c1b-4022-a9c2-bc5adf3be888 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:27.683413 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-000a049e-2c1b-4022-a9c2-bc5adf3be888 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:27.683906 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-000a049e-2c1b-4022-a9c2-bc5adf3be888 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:27.684339 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-000a049e-2c1b-4022-a9c2-bc5adf3be888 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:27.816633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-000a049e-2c1b-4022-a9c2-bc5adf3be888 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:27.825911 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-000a049e-2c1b-4022-a9c2-bc5adf3be888 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.155360 Sep 19 17:24:27.830059 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 80/165] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:27 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:28.848593 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6426255e-5e84-4c79-904c-b969bf9991cf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:28.849205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6426255e-5e84-4c79-904c-b969bf9991cf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:28.856640 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6426255e-5e84-4c79-904c-b969bf9991cf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:28.857131 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6426255e-5e84-4c79-904c-b969bf9991cf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:28.857567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6426255e-5e84-4c79-904c-b969bf9991cf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:28.858270 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6426255e-5e84-4c79-904c-b969bf9991cf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:28.858756 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6426255e-5e84-4c79-904c-b969bf9991cf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:28.859186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6426255e-5e84-4c79-904c-b969bf9991cf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:29.009493 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6426255e-5e84-4c79-904c-b969bf9991cf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:29.019587 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6426255e-5e84-4c79-904c-b969bf9991cf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.173006 Sep 19 17:24:29.019587 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 86/166] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:28 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:30.042119 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb8a816e-a340-4e5d-9d4f-f22b894df87b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:30.042719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb8a816e-a340-4e5d-9d4f-f22b894df87b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:30.049264 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb8a816e-a340-4e5d-9d4f-f22b894df87b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:30.049758 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb8a816e-a340-4e5d-9d4f-f22b894df87b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:30.050219 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb8a816e-a340-4e5d-9d4f-f22b894df87b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:30.050919 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb8a816e-a340-4e5d-9d4f-f22b894df87b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:30.051381 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb8a816e-a340-4e5d-9d4f-f22b894df87b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:30.051848 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb8a816e-a340-4e5d-9d4f-f22b894df87b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:30.186681 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb8a816e-a340-4e5d-9d4f-f22b894df87b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:30.194493 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb8a816e-a340-4e5d-9d4f-f22b894df87b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.156989 Sep 19 17:24:30.195059 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 81/167] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:30 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:31.219158 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88dc03c5-31e8-4944-ac1d-7cad23e2b0ce tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:31.219799 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-88dc03c5-31e8-4944-ac1d-7cad23e2b0ce tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:31.226620 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88dc03c5-31e8-4944-ac1d-7cad23e2b0ce tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:31.227213 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88dc03c5-31e8-4944-ac1d-7cad23e2b0ce tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:31.227774 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88dc03c5-31e8-4944-ac1d-7cad23e2b0ce tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:31.228539 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88dc03c5-31e8-4944-ac1d-7cad23e2b0ce tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:31.234033 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88dc03c5-31e8-4944-ac1d-7cad23e2b0ce tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:31.234033 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88dc03c5-31e8-4944-ac1d-7cad23e2b0ce tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:31.361033 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-88dc03c5-31e8-4944-ac1d-7cad23e2b0ce tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:31.369064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-88dc03c5-31e8-4944-ac1d-7cad23e2b0ce tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.153742 Sep 19 17:24:31.370301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 87/168] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:31 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:32.393037 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-196e31eb-d174-451d-ab45-f18ac61a074f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:32.393628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-196e31eb-d174-451d-ab45-f18ac61a074f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:32.400378 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196e31eb-d174-451d-ab45-f18ac61a074f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:32.400985 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196e31eb-d174-451d-ab45-f18ac61a074f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:32.401429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196e31eb-d174-451d-ab45-f18ac61a074f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:32.402129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196e31eb-d174-451d-ab45-f18ac61a074f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:32.402587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196e31eb-d174-451d-ab45-f18ac61a074f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:32.403016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196e31eb-d174-451d-ab45-f18ac61a074f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:32.407248 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:32.545232 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-196e31eb-d174-451d-ab45-f18ac61a074f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:32.554719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-196e31eb-d174-451d-ab45-f18ac61a074f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.165676 Sep 19 17:24:32.555305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 82/169] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:32 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:33.258456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-174713591", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "networks": [{"uuid": "dbea844a-2578-4e15-bc5c-36f1d79899e8"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:24:33.321114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] validate_networks() for [('dbea844a-2578-4e15-bc5c-36f1d79899e8', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:24:33.578596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc8adaf3-4daa-4f20-b174-505cbcb13e48 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:33.580093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fc8adaf3-4daa-4f20-b174-505cbcb13e48 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:33.587767 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc8adaf3-4daa-4f20-b174-505cbcb13e48 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:33.588503 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc8adaf3-4daa-4f20-b174-505cbcb13e48 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:33.589159 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc8adaf3-4daa-4f20-b174-505cbcb13e48 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:33.590027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc8adaf3-4daa-4f20-b174-505cbcb13e48 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:33.590647 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc8adaf3-4daa-4f20-b174-505cbcb13e48 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:33.591308 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc8adaf3-4daa-4f20-b174-505cbcb13e48 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:33.811456 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc8adaf3-4daa-4f20-b174-505cbcb13e48 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:33.819446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc8adaf3-4daa-4f20-b174-505cbcb13e48 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.244807 Sep 19 17:24:33.820543 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 83/170] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:33 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:33.861663 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:24:33.862115 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:24:33.862593 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:24:33.863159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:24:33.864476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:24:33.878952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:33.879428 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:33.879889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:33.880683 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:33.881130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:33.881549 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:33.898121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Getting quotas for project 521a7d164d1343aa95087e1d4b5ebb11. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:24:33.902428 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Getting quotas for user 12b26d6cd2fc4657bb9682065168cd71 and project 521a7d164d1343aa95087e1d4b5ebb11. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:24:33.913210 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:24:33.915458 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:24:34.069800 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d083cc88-c7ae-4e90-87ab-4beef851aafe tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815362 Sep 19 17:24:34.070985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 88/171] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:24:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:24:34.082465 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e1e4df7-8e55-4297-9d76-d67e7dcee4d3 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:34.083550 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7e1e4df7-8e55-4297-9d76-d67e7dcee4d3 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:34.173412 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e1e4df7-8e55-4297-9d76-d67e7dcee4d3 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:34.181035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e1e4df7-8e55-4297-9d76-d67e7dcee4d3 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1213 microversion: 2.1 time: 0.102599 Sep 19 17:24:34.181801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 84/172] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:34 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:34.844437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-45dea317-102a-46c1-b4bf-649f98fcf043 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:34.845060 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45dea317-102a-46c1-b4bf-649f98fcf043 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:34.851541 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45dea317-102a-46c1-b4bf-649f98fcf043 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:34.852075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45dea317-102a-46c1-b4bf-649f98fcf043 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:34.852531 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45dea317-102a-46c1-b4bf-649f98fcf043 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:34.853240 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45dea317-102a-46c1-b4bf-649f98fcf043 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:34.854279 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45dea317-102a-46c1-b4bf-649f98fcf043 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:34.854713 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45dea317-102a-46c1-b4bf-649f98fcf043 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:35.002998 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-45dea317-102a-46c1-b4bf-649f98fcf043 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:35.011331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-45dea317-102a-46c1-b4bf-649f98fcf043 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.170887 Sep 19 17:24:35.011931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 89/173] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:34 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:35.204657 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9909dc67-66da-4d4c-ac6b-780b3ed58fee tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:35.206370 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9909dc67-66da-4d4c-ac6b-780b3ed58fee tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:35.269438 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9909dc67-66da-4d4c-ac6b-780b3ed58fee tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:35.277234 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9909dc67-66da-4d4c-ac6b-780b3ed58fee tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1213 microversion: 2.1 time: 0.076521 Sep 19 17:24:35.277832 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 85/174] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:35 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:36.026641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-69c7ff92-a650-4795-85de-5c48ac2bc8a1 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:36.027131 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-69c7ff92-a650-4795-85de-5c48ac2bc8a1 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:36.034608 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69c7ff92-a650-4795-85de-5c48ac2bc8a1 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:36.035294 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69c7ff92-a650-4795-85de-5c48ac2bc8a1 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:36.036027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69c7ff92-a650-4795-85de-5c48ac2bc8a1 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:36.036863 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-538d6696-11cc-432d-8eb3-7cb60a60a84f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:36.041263 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69c7ff92-a650-4795-85de-5c48ac2bc8a1 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:36.041395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-538d6696-11cc-432d-8eb3-7cb60a60a84f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:36.041498 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69c7ff92-a650-4795-85de-5c48ac2bc8a1 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:36.041498 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69c7ff92-a650-4795-85de-5c48ac2bc8a1 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:36.043797 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d6696-11cc-432d-8eb3-7cb60a60a84f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:36.044296 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d6696-11cc-432d-8eb3-7cb60a60a84f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:36.044738 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d6696-11cc-432d-8eb3-7cb60a60a84f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:36.045428 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d6696-11cc-432d-8eb3-7cb60a60a84f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:36.045884 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d6696-11cc-432d-8eb3-7cb60a60a84f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:36.046307 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d6696-11cc-432d-8eb3-7cb60a60a84f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:36.070230 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-69c7ff92-a650-4795-85de-5c48ac2bc8a1 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:24:36.195236 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-538d6696-11cc-432d-8eb3-7cb60a60a84f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:36.204736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-538d6696-11cc-432d-8eb3-7cb60a60a84f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.172986 Sep 19 17:24:36.205331 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 86/175] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:36 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:36.299577 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec79d526-cb1a-4c04-982d-2f64a1c38e39 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:36.300235 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec79d526-cb1a-4c04-982d-2f64a1c38e39 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:36.307491 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec79d526-cb1a-4c04-982d-2f64a1c38e39 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:36.308012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec79d526-cb1a-4c04-982d-2f64a1c38e39 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:36.308628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec79d526-cb1a-4c04-982d-2f64a1c38e39 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:36.309342 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec79d526-cb1a-4c04-982d-2f64a1c38e39 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:36.309802 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec79d526-cb1a-4c04-982d-2f64a1c38e39 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:36.310238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec79d526-cb1a-4c04-982d-2f64a1c38e39 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:36.400781 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ec79d526-cb1a-4c04-982d-2f64a1c38e39 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:36.413521 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec79d526-cb1a-4c04-982d-2f64a1c38e39 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1265 microversion: 2.1 time: 0.117786 Sep 19 17:24:36.414802 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 87/176] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:36 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:36.425989 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-69c7ff92-a650-4795-85de-5c48ac2bc8a1 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "DELETE /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 204 len: 0 microversion: 2.1 time: 0.403067 Sep 19 17:24:36.426582 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 90/177] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:24:36 2022] DELETE /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:24:36.440497 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76430bec-cb79-4463-bf72-10a75cce345d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:36.441112 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-76430bec-cb79-4463-bf72-10a75cce345d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:36.447382 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76430bec-cb79-4463-bf72-10a75cce345d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:36.448105 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76430bec-cb79-4463-bf72-10a75cce345d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:36.448705 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76430bec-cb79-4463-bf72-10a75cce345d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:36.449679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76430bec-cb79-4463-bf72-10a75cce345d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:36.450355 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76430bec-cb79-4463-bf72-10a75cce345d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:36.450963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76430bec-cb79-4463-bf72-10a75cce345d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:36.591568 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-76430bec-cb79-4463-bf72-10a75cce345d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:36.599993 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76430bec-cb79-4463-bf72-10a75cce345d tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1553 microversion: 2.1 time: 0.165618 Sep 19 17:24:36.600563 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 88/178] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:36 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:37.228582 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c49990d-c9fd-40f5-82a2-133acf07f550 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:37.229209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c49990d-c9fd-40f5-82a2-133acf07f550 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:37.235064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c49990d-c9fd-40f5-82a2-133acf07f550 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:37.235549 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c49990d-c9fd-40f5-82a2-133acf07f550 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:37.236023 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c49990d-c9fd-40f5-82a2-133acf07f550 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:37.236716 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c49990d-c9fd-40f5-82a2-133acf07f550 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:37.237177 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c49990d-c9fd-40f5-82a2-133acf07f550 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:37.237652 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c49990d-c9fd-40f5-82a2-133acf07f550 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:37.363744 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6c49990d-c9fd-40f5-82a2-133acf07f550 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:37.372067 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c49990d-c9fd-40f5-82a2-133acf07f550 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.147857 Sep 19 17:24:37.372640 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 91/179] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:37 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:37.438672 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c83e4111-90d6-4500-90e4-0e2a00579603 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:37.439282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c83e4111-90d6-4500-90e4-0e2a00579603 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:37.445708 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c83e4111-90d6-4500-90e4-0e2a00579603 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:37.446196 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c83e4111-90d6-4500-90e4-0e2a00579603 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:37.446637 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c83e4111-90d6-4500-90e4-0e2a00579603 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:37.447860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c83e4111-90d6-4500-90e4-0e2a00579603 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:37.448368 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c83e4111-90d6-4500-90e4-0e2a00579603 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:37.448844 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c83e4111-90d6-4500-90e4-0e2a00579603 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:37.517956 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c83e4111-90d6-4500-90e4-0e2a00579603 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:37.527956 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c83e4111-90d6-4500-90e4-0e2a00579603 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1265 microversion: 2.1 time: 0.093137 Sep 19 17:24:37.529568 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 89/180] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:37 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:37.623087 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2c208b2-4fa2-4e6d-9f43-7d9e40cf3d2e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:37.623717 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2c208b2-4fa2-4e6d-9f43-7d9e40cf3d2e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:37.629869 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c208b2-4fa2-4e6d-9f43-7d9e40cf3d2e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:37.630355 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c208b2-4fa2-4e6d-9f43-7d9e40cf3d2e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:37.630791 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c208b2-4fa2-4e6d-9f43-7d9e40cf3d2e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:37.631522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c208b2-4fa2-4e6d-9f43-7d9e40cf3d2e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:37.632091 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c208b2-4fa2-4e6d-9f43-7d9e40cf3d2e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:37.632495 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c208b2-4fa2-4e6d-9f43-7d9e40cf3d2e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:37.766999 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e2c208b2-4fa2-4e6d-9f43-7d9e40cf3d2e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:37.776140 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2c208b2-4fa2-4e6d-9f43-7d9e40cf3d2e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1553 microversion: 2.1 time: 0.157454 Sep 19 17:24:37.776715 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 92/181] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:37 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:38.396073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b708f3d-70b8-4838-823b-23b02b007e73 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:38.396695 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b708f3d-70b8-4838-823b-23b02b007e73 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:38.403666 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b708f3d-70b8-4838-823b-23b02b007e73 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:38.404173 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b708f3d-70b8-4838-823b-23b02b007e73 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:38.404604 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b708f3d-70b8-4838-823b-23b02b007e73 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:38.405290 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b708f3d-70b8-4838-823b-23b02b007e73 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:38.405746 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b708f3d-70b8-4838-823b-23b02b007e73 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:38.406164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b708f3d-70b8-4838-823b-23b02b007e73 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:38.562425 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e3d5050-f9d7-4848-9147-be5fcc09c6ff tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:38.562425 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e3d5050-f9d7-4848-9147-be5fcc09c6ff tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:38.566507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b708f3d-70b8-4838-823b-23b02b007e73 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:38.570958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3d5050-f9d7-4848-9147-be5fcc09c6ff tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:38.571452 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3d5050-f9d7-4848-9147-be5fcc09c6ff tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:38.573498 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3d5050-f9d7-4848-9147-be5fcc09c6ff tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:38.574212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3d5050-f9d7-4848-9147-be5fcc09c6ff tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:38.574691 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3d5050-f9d7-4848-9147-be5fcc09c6ff tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:38.575744 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3d5050-f9d7-4848-9147-be5fcc09c6ff tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:38.586418 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b708f3d-70b8-4838-823b-23b02b007e73 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.191554 Sep 19 17:24:38.587381 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 90/182] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:38 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:38.665017 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2e3d5050-f9d7-4848-9147-be5fcc09c6ff tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:38.673505 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e3d5050-f9d7-4848-9147-be5fcc09c6ff tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1265 microversion: 2.1 time: 0.117012 Sep 19 17:24:38.674098 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 93/183] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:38 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:38.799950 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d93a8abc-1a31-492d-9199-5774ad26e6a6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:38.800643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d93a8abc-1a31-492d-9199-5774ad26e6a6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:38.806594 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93a8abc-1a31-492d-9199-5774ad26e6a6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:38.807092 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93a8abc-1a31-492d-9199-5774ad26e6a6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:38.807535 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93a8abc-1a31-492d-9199-5774ad26e6a6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:38.808259 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93a8abc-1a31-492d-9199-5774ad26e6a6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:38.808717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93a8abc-1a31-492d-9199-5774ad26e6a6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:38.809147 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93a8abc-1a31-492d-9199-5774ad26e6a6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:38.986503 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d93a8abc-1a31-492d-9199-5774ad26e6a6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:38.995896 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d93a8abc-1a31-492d-9199-5774ad26e6a6 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1553 microversion: 2.1 time: 0.199707 Sep 19 17:24:39.008083 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 91/184] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:38 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:39.613225 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-46ac608e-d25f-4502-9800-5119e4e0ab43 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:39.613824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-46ac608e-d25f-4502-9800-5119e4e0ab43 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:39.620721 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46ac608e-d25f-4502-9800-5119e4e0ab43 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:39.621196 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46ac608e-d25f-4502-9800-5119e4e0ab43 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:39.621636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46ac608e-d25f-4502-9800-5119e4e0ab43 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:39.622341 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46ac608e-d25f-4502-9800-5119e4e0ab43 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:39.622849 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46ac608e-d25f-4502-9800-5119e4e0ab43 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:39.623260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46ac608e-d25f-4502-9800-5119e4e0ab43 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:39.699888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0f4f4b2d-3c44-4d35-be0e-128bc1f1854e tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:39.700564 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0f4f4b2d-3c44-4d35-be0e-128bc1f1854e tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:39.714754 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f4f4b2d-3c44-4d35-be0e-128bc1f1854e tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:39.715352 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f4f4b2d-3c44-4d35-be0e-128bc1f1854e tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:39.715826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f4f4b2d-3c44-4d35-be0e-128bc1f1854e tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:39.716526 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f4f4b2d-3c44-4d35-be0e-128bc1f1854e tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:39.717005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f4f4b2d-3c44-4d35-be0e-128bc1f1854e tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:39.717424 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f4f4b2d-3c44-4d35-be0e-128bc1f1854e tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:39.830532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f4f4b2d-3c44-4d35-be0e-128bc1f1854e tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:39.840778 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0f4f4b2d-3c44-4d35-be0e-128bc1f1854e tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1265 microversion: 2.1 time: 0.147453 Sep 19 17:24:39.842584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 92/185] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:39 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:39.886109 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-46ac608e-d25f-4502-9800-5119e4e0ab43 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:39.894071 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-46ac608e-d25f-4502-9800-5119e4e0ab43 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.284821 Sep 19 17:24:39.895197 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 94/186] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:39 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:40.021033 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7b03add9-0e80-4aa7-83d2-119bf6e31369 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:40.021645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7b03add9-0e80-4aa7-83d2-119bf6e31369 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:40.028324 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b03add9-0e80-4aa7-83d2-119bf6e31369 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:40.029075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b03add9-0e80-4aa7-83d2-119bf6e31369 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:40.029495 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b03add9-0e80-4aa7-83d2-119bf6e31369 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:40.030187 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b03add9-0e80-4aa7-83d2-119bf6e31369 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:40.030752 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b03add9-0e80-4aa7-83d2-119bf6e31369 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:40.031178 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b03add9-0e80-4aa7-83d2-119bf6e31369 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:40.255868 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7b03add9-0e80-4aa7-83d2-119bf6e31369 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:40.269493 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7b03add9-0e80-4aa7-83d2-119bf6e31369 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1553 microversion: 2.1 time: 0.252614 Sep 19 17:24:40.270453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 93/187] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:40 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1553 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:40.865877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4272d1bf-8dc1-4abf-9d9e-b26d951b362c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:40.866796 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4272d1bf-8dc1-4abf-9d9e-b26d951b362c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:40.874086 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4272d1bf-8dc1-4abf-9d9e-b26d951b362c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:40.874879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4272d1bf-8dc1-4abf-9d9e-b26d951b362c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:40.875470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4272d1bf-8dc1-4abf-9d9e-b26d951b362c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:40.876424 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4272d1bf-8dc1-4abf-9d9e-b26d951b362c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:40.879437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4272d1bf-8dc1-4abf-9d9e-b26d951b362c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:40.879437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4272d1bf-8dc1-4abf-9d9e-b26d951b362c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:40.919895 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75087495-7fec-4add-8ddc-857a06ea9019 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:40.921042 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-75087495-7fec-4add-8ddc-857a06ea9019 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:40.929979 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75087495-7fec-4add-8ddc-857a06ea9019 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:40.930714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75087495-7fec-4add-8ddc-857a06ea9019 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:40.932540 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75087495-7fec-4add-8ddc-857a06ea9019 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:40.933449 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75087495-7fec-4add-8ddc-857a06ea9019 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:40.934080 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75087495-7fec-4add-8ddc-857a06ea9019 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:40.935616 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75087495-7fec-4add-8ddc-857a06ea9019 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:40.995418 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4272d1bf-8dc1-4abf-9d9e-b26d951b362c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:41.003962 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4272d1bf-8dc1-4abf-9d9e-b26d951b362c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1283 microversion: 2.1 time: 0.142101 Sep 19 17:24:41.004831 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 95/188] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:40 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1283 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:41.094598 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-75087495-7fec-4add-8ddc-857a06ea9019 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:41.102573 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-75087495-7fec-4add-8ddc-857a06ea9019 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.188685 Sep 19 17:24:41.103146 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 94/189] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:40 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:41.295144 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3463cfbc-caab-4f7a-8567-4140fa0f21d0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:41.295991 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3463cfbc-caab-4f7a-8567-4140fa0f21d0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:41.310297 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3463cfbc-caab-4f7a-8567-4140fa0f21d0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:41.310811 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3463cfbc-caab-4f7a-8567-4140fa0f21d0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:41.311244 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3463cfbc-caab-4f7a-8567-4140fa0f21d0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:41.312067 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3463cfbc-caab-4f7a-8567-4140fa0f21d0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:41.312543 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3463cfbc-caab-4f7a-8567-4140fa0f21d0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:41.312970 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3463cfbc-caab-4f7a-8567-4140fa0f21d0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:41.527726 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3463cfbc-caab-4f7a-8567-4140fa0f21d0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:41.537888 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3463cfbc-caab-4f7a-8567-4140fa0f21d0 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1553 microversion: 2.1 time: 0.247436 Sep 19 17:24:41.538490 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 96/190] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:41 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1553 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:41.793721 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-30b1c735-c307-49dd-a5db-ca0d1ea96bd8 req-84e28e1a-f165-4783-90d0-b4d12e4b488e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174c5ef6-abf1-465c-afed-96d456b50c8e", "name": "network-vif-deleted", "tag": "95fe2876-ad84-4782-b5da-88dc57844f07"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:24:41.815838 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-30b1c735-c307-49dd-a5db-ca0d1ea96bd8 req-84e28e1a-f165-4783-90d0-b4d12e4b488e service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:41.816323 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-30b1c735-c307-49dd-a5db-ca0d1ea96bd8 req-84e28e1a-f165-4783-90d0-b4d12e4b488e service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:41.816939 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-30b1c735-c307-49dd-a5db-ca0d1ea96bd8 req-84e28e1a-f165-4783-90d0-b4d12e4b488e service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:41.830390 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-30b1c735-c307-49dd-a5db-ca0d1ea96bd8 req-84e28e1a-f165-4783-90d0-b4d12e4b488e service nova] Creating event network-vif-deleted:95fe2876-ad84-4782-b5da-88dc57844f07 for instance 174c5ef6-abf1-465c-afed-96d456b50c8e on hv-cinder-84801 Sep 19 17:24:41.843363 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-30b1c735-c307-49dd-a5db-ca0d1ea96bd8 req-84e28e1a-f165-4783-90d0-b4d12e4b488e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057679 Sep 19 17:24:41.848524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 95/191] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:24:42.036462 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65bd1c46-748b-4353-8fc3-eb96cc4246bb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:42.038397 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-65bd1c46-748b-4353-8fc3-eb96cc4246bb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:42.052080 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65bd1c46-748b-4353-8fc3-eb96cc4246bb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:42.052805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65bd1c46-748b-4353-8fc3-eb96cc4246bb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:42.053545 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65bd1c46-748b-4353-8fc3-eb96cc4246bb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:42.054891 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65bd1c46-748b-4353-8fc3-eb96cc4246bb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:42.056783 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65bd1c46-748b-4353-8fc3-eb96cc4246bb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:42.057923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65bd1c46-748b-4353-8fc3-eb96cc4246bb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:42.132313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8db7dd1d-0e39-4814-b688-951aae4f7a81 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:42.138878 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8db7dd1d-0e39-4814-b688-951aae4f7a81 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:42.169890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8db7dd1d-0e39-4814-b688-951aae4f7a81 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:42.171307 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8db7dd1d-0e39-4814-b688-951aae4f7a81 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:42.173982 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8db7dd1d-0e39-4814-b688-951aae4f7a81 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:42.179336 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8db7dd1d-0e39-4814-b688-951aae4f7a81 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:42.181305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8db7dd1d-0e39-4814-b688-951aae4f7a81 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:42.183933 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8db7dd1d-0e39-4814-b688-951aae4f7a81 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:42.362672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-65bd1c46-748b-4353-8fc3-eb96cc4246bb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:42.373598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-65bd1c46-748b-4353-8fc3-eb96cc4246bb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1313 microversion: 2.1 time: 0.347999 Sep 19 17:24:42.373598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 97/192] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:42 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:42.485719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8db7dd1d-0e39-4814-b688-951aae4f7a81 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:42.506518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8db7dd1d-0e39-4814-b688-951aae4f7a81 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.382402 Sep 19 17:24:42.507348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 96/193] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:42 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:42.562784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7cac314e-92cf-4e96-9b3a-b3723afa66a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:42.563402 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7cac314e-92cf-4e96-9b3a-b3723afa66a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:42.569796 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cac314e-92cf-4e96-9b3a-b3723afa66a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:42.570301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cac314e-92cf-4e96-9b3a-b3723afa66a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:42.570956 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cac314e-92cf-4e96-9b3a-b3723afa66a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:42.572036 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cac314e-92cf-4e96-9b3a-b3723afa66a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:42.572492 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cac314e-92cf-4e96-9b3a-b3723afa66a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:42.573139 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cac314e-92cf-4e96-9b3a-b3723afa66a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:42.708563 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7cac314e-92cf-4e96-9b3a-b3723afa66a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:42.719020 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7cac314e-92cf-4e96-9b3a-b3723afa66a3 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1345 microversion: 2.1 time: 0.160607 Sep 19 17:24:42.719608 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 98/194] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:42 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:43.404268 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1740915c-8380-4bc8-af1b-1693661b1d20 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:43.405779 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1740915c-8380-4bc8-af1b-1693661b1d20 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:43.421516 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1740915c-8380-4bc8-af1b-1693661b1d20 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:43.422572 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1740915c-8380-4bc8-af1b-1693661b1d20 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:43.423237 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1740915c-8380-4bc8-af1b-1693661b1d20 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:43.424266 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1740915c-8380-4bc8-af1b-1693661b1d20 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:43.425012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1740915c-8380-4bc8-af1b-1693661b1d20 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:43.425977 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1740915c-8380-4bc8-af1b-1693661b1d20 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:43.533286 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-331d6cbc-aada-4a44-bcd3-7b0fad29f106 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:43.534066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-331d6cbc-aada-4a44-bcd3-7b0fad29f106 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:43.545206 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-331d6cbc-aada-4a44-bcd3-7b0fad29f106 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:43.548865 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-331d6cbc-aada-4a44-bcd3-7b0fad29f106 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:43.549434 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-331d6cbc-aada-4a44-bcd3-7b0fad29f106 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:43.550189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-331d6cbc-aada-4a44-bcd3-7b0fad29f106 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:43.550710 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-331d6cbc-aada-4a44-bcd3-7b0fad29f106 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:43.553656 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-331d6cbc-aada-4a44-bcd3-7b0fad29f106 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:43.663329 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1740915c-8380-4bc8-af1b-1693661b1d20 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:43.679887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1740915c-8380-4bc8-af1b-1693661b1d20 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1313 microversion: 2.1 time: 0.282024 Sep 19 17:24:43.685128 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 97/195] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:43 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:43.745320 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:43.745320 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:43.749189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:43.749674 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:43.750196 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:43.750845 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:43.751291 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:43.751742 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:43.787225 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-331d6cbc-aada-4a44-bcd3-7b0fad29f106 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:43.789399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:43.789975 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:43.790620 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:43.790785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:43.792116 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lazy-loading 'fault' on Instance uuid 174c5ef6-abf1-465c-afed-96d456b50c8e {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:24:43.808144 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-331d6cbc-aada-4a44-bcd3-7b0fad29f106 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.277517 Sep 19 17:24:43.813081 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 99/196] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:43 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:43.867723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3b420b0f64c848c49b8149518e55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bab2edcfa684d8a8befcb705fe3990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:43.876695 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f1c55962-9780-469a-a05c-688de9890eb8 req-716c944f-5b9f-449b-a2fa-35ffe5663725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6311f1a9-d9cd-411a-a3f2-0133fbfca6d9", "tag": "10c3ac96-1fd1-4d57-b5fb-360aecc85b11"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:24:43.878294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b15de61b-b89e-4b23-801e-76b93a3f7d8e tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 200 len: 1350 microversion: 2.1 time: 0.139663 Sep 19 17:24:43.879396 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 98/197] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:43 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:43.892159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f1c55962-9780-469a-a05c-688de9890eb8 req-716c944f-5b9f-449b-a2fa-35ffe5663725 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:43.892653 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f1c55962-9780-469a-a05c-688de9890eb8 req-716c944f-5b9f-449b-a2fa-35ffe5663725 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:43.893409 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f1c55962-9780-469a-a05c-688de9890eb8 req-716c944f-5b9f-449b-a2fa-35ffe5663725 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:43.907056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:43.918589 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:43.928636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f1c55962-9780-469a-a05c-688de9890eb8 req-716c944f-5b9f-449b-a2fa-35ffe5663725 service nova] Creating event network-changed:10c3ac96-1fd1-4d57-b5fb-360aecc85b11 for instance 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 on hv-cinder-84801 Sep 19 17:24:43.938419 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f1c55962-9780-469a-a05c-688de9890eb8 req-716c944f-5b9f-449b-a2fa-35ffe5663725 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066330 Sep 19 17:24:43.939591 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 100/198] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:24:44.707805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a67f3962-5cef-438e-8199-bc5e1592fab1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:44.708451 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a67f3962-5cef-438e-8199-bc5e1592fab1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:44.716826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a67f3962-5cef-438e-8199-bc5e1592fab1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:44.717359 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a67f3962-5cef-438e-8199-bc5e1592fab1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:44.717876 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a67f3962-5cef-438e-8199-bc5e1592fab1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:44.718636 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a67f3962-5cef-438e-8199-bc5e1592fab1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:44.719645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a67f3962-5cef-438e-8199-bc5e1592fab1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:44.720110 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a67f3962-5cef-438e-8199-bc5e1592fab1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:44.844008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c72519f2-3c9a-4091-a4ee-bfc06b2848d2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:44.844821 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c72519f2-3c9a-4091-a4ee-bfc06b2848d2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:44.852319 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72519f2-3c9a-4091-a4ee-bfc06b2848d2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:44.852985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72519f2-3c9a-4091-a4ee-bfc06b2848d2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:44.853353 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72519f2-3c9a-4091-a4ee-bfc06b2848d2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:44.854046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72519f2-3c9a-4091-a4ee-bfc06b2848d2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:44.854499 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72519f2-3c9a-4091-a4ee-bfc06b2848d2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:44.854925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72519f2-3c9a-4091-a4ee-bfc06b2848d2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:44.861328 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a67f3962-5cef-438e-8199-bc5e1592fab1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:44.867208 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a67f3962-5cef-438e-8199-bc5e1592fab1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1313 microversion: 2.1 time: 0.164449 Sep 19 17:24:44.867807 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 99/199] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:44 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:44.904800 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:44.905696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:44.915013 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:44.915517 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:44.915989 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:44.916696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:44.917155 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:44.917584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:44.933729 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] HTTP exception thrown: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Request method failure captured: Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e HTTP/1.1 Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWJu0dSwXuVDj3Rb2sQ6tTQHTa09W91SOB3JIk41tU11VBTIpSdjBKDSAGxxVl3Dr_gO34NGKHGO_MBa_g1E1Ic2-wTw8N6AAC9HN6LUNnSxiFP0Pl3KgnwwNFJDaDlYeuhXuZdnjcRLNth3AnmuscKIrsmvuqoomTEPsLgGq1wpGo Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 1bab2edcfa684d8a8befcb705fe3990e Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:24:44.938333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1bab2edcfa684d8a8befcb705fe3990e"}]}] Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 1bab2edcfa684d8a8befcb705fe3990e Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-492183407-project Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 90d3b420b0f64c848c49b8149518e55e Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-492183407-project Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:44.939912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '174c5ef6-abf1-465c-afed-96d456b50c8e'} Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:24:44.940851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:44.942164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:44.943182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Returning 404 to user: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:24:44.943182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8a93561a-94b5-4a4d-8752-f019858d9cc2 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 404 len: 111 microversion: 2.1 time: 0.039577 Sep 19 17:24:44.943182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 100/200] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:44 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 17:24:44.992724 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c72519f2-3c9a-4091-a4ee-bfc06b2848d2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:45.001048 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c72519f2-3c9a-4091-a4ee-bfc06b2848d2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.163031 Sep 19 17:24:45.012083 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 101/201] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:44 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:45.252821 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:45.255097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:45.262479 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:45.263030 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:45.263589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:45.264763 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:45.265415 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:45.266067 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:45.282214 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:45.284357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] HTTP exception thrown: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Request method failure captured: Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e/os-volume_attachments HTTP/1.1 Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWJu0dSwXuVDj3Rb2sQ6tTQHTa09W91SOB3JIk41tU11VBTIpSdjBKDSAGxxVl3Dr_gO34NGKHGO_MBa_g1E1Ic2-wTw8N6AAC9HN6LUNnSxiFP0Pl3KgnwwNFJDaDlYeuhXuZdnjcRLNth3AnmuscKIrsmvuqoomTEPsLgGq1wpGo Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 1bab2edcfa684d8a8befcb705fe3990e Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:24:45.287585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1bab2edcfa684d8a8befcb705fe3990e"}]}] Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 1bab2edcfa684d8a8befcb705fe3990e Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-492183407-project Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 90d3b420b0f64c848c49b8149518e55e Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-492183407-project Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:45.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'server_id': '174c5ef6-abf1-465c-afed-96d456b50c8e'} Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:24:45.289530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:45.290565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:45.292910 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Returning 404 to user: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:24:45.293808 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4af1afe7-82e9-4a08-83ac-27dc30231b71 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044969 Sep 19 17:24:45.294366 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 101/202] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:24:45 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:24:45.890790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0115168a-5f39-41bc-b29f-9f1adc205d4d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:45.891535 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0115168a-5f39-41bc-b29f-9f1adc205d4d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:45.898262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0115168a-5f39-41bc-b29f-9f1adc205d4d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:45.898792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0115168a-5f39-41bc-b29f-9f1adc205d4d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:45.899242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0115168a-5f39-41bc-b29f-9f1adc205d4d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:45.900012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0115168a-5f39-41bc-b29f-9f1adc205d4d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:45.900478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0115168a-5f39-41bc-b29f-9f1adc205d4d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:45.900909 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0115168a-5f39-41bc-b29f-9f1adc205d4d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:46.025502 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4292edd-0cf5-49cb-b7cc-de0cc49fcc7f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:46.026232 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c4292edd-0cf5-49cb-b7cc-de0cc49fcc7f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:46.032627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4292edd-0cf5-49cb-b7cc-de0cc49fcc7f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:46.033198 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4292edd-0cf5-49cb-b7cc-de0cc49fcc7f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:46.033722 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4292edd-0cf5-49cb-b7cc-de0cc49fcc7f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:46.034652 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4292edd-0cf5-49cb-b7cc-de0cc49fcc7f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:46.035120 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4292edd-0cf5-49cb-b7cc-de0cc49fcc7f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:46.035577 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4292edd-0cf5-49cb-b7cc-de0cc49fcc7f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:46.042553 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0115168a-5f39-41bc-b29f-9f1adc205d4d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:46.050594 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0115168a-5f39-41bc-b29f-9f1adc205d4d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1313 microversion: 2.1 time: 0.163652 Sep 19 17:24:46.051800 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 102/203] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:45 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:46.054950 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:46.347245 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c4292edd-0cf5-49cb-b7cc-de0cc49fcc7f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:46.356893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c4292edd-0cf5-49cb-b7cc-de0cc49fcc7f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.335804 Sep 19 17:24:46.373364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 102/204] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:46 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:47.074472 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73591e2c-15fc-4dc5-8053-52d12ab81d3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:47.075081 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-73591e2c-15fc-4dc5-8053-52d12ab81d3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:47.081190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73591e2c-15fc-4dc5-8053-52d12ab81d3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:47.081684 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73591e2c-15fc-4dc5-8053-52d12ab81d3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:47.082128 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73591e2c-15fc-4dc5-8053-52d12ab81d3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:47.082861 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73591e2c-15fc-4dc5-8053-52d12ab81d3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:47.083367 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73591e2c-15fc-4dc5-8053-52d12ab81d3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:47.083820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73591e2c-15fc-4dc5-8053-52d12ab81d3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:47.227812 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-73591e2c-15fc-4dc5-8053-52d12ab81d3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:47.238342 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73591e2c-15fc-4dc5-8053-52d12ab81d3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1313 microversion: 2.1 time: 0.168146 Sep 19 17:24:47.239069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 103/205] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:47 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:47.380875 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2ce29d2-5528-40e9-a219-d92b5e5b525c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:47.381496 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b2ce29d2-5528-40e9-a219-d92b5e5b525c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:47.383804 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=64 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:47.388568 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ce29d2-5528-40e9-a219-d92b5e5b525c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:47.389140 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ce29d2-5528-40e9-a219-d92b5e5b525c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:47.389656 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ce29d2-5528-40e9-a219-d92b5e5b525c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:47.390366 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ce29d2-5528-40e9-a219-d92b5e5b525c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:47.390826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ce29d2-5528-40e9-a219-d92b5e5b525c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:47.391257 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ce29d2-5528-40e9-a219-d92b5e5b525c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:47.530606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b2ce29d2-5528-40e9-a219-d92b5e5b525c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:47.538625 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2ce29d2-5528-40e9-a219-d92b5e5b525c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.161871 Sep 19 17:24:47.539519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 103/206] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:47 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:47.712440 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:47.713548 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:47.721284 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:47.721284 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:47.721485 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:47.725361 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:47.725846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:47.726293 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:47.740474 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] HTTP exception thrown: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Request method failure captured: Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e HTTP/1.1 Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKWJu0dSwXuVDj3Rb2sQ6tTQHTa09W91SOB3JIk41tU11VBTIpSdjBKDSAGxxVl3Dr_gO34NGKHGO_MBa_g1E1Ic2-wTw8N6AAC9HN6LUNnSxiFP0Pl3KgnwwNFJDaDlYeuhXuZdnjcRLNth3AnmuscKIrsmvuqoomTEPsLgGq1wpGo Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 1bab2edcfa684d8a8befcb705fe3990e Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:24:47.745445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1bab2edcfa684d8a8befcb705fe3990e"}]}] Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 1bab2edcfa684d8a8befcb705fe3990e Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-492183407-project Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 90d3b420b0f64c848c49b8149518e55e Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-492183407-project Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:47.747012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '174c5ef6-abf1-465c-afed-96d456b50c8e'} Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:24:47.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:47.749703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:24:47.751110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Returning 404 to user: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:24:47.751110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-40db20db-1feb-4b4d-902f-d1d91275531a tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "DELETE /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 404 len: 111 microversion: 2.1 time: 0.039265 Sep 19 17:24:47.751110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 104/207] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:24:47 2022] DELETE /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:24:47.756811 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:47.757501 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] [instance: 174c5ef6-abf1-465c-afed-96d456b50c8e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:47.765247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:47.765938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:47.766111 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:47.766847 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:47.767476 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:47.768051 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:47.784190 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] HTTP exception thrown: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Request method failure captured: Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e HTTP/1.1 Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWJu0dSwXuVDj3Rb2sQ6tTQHTa09W91SOB3JIk41tU11VBTIpSdjBKDSAGxxVl3Dr_gO34NGKHGO_MBa_g1E1Ic2-wTw8N6AAC9HN6LUNnSxiFP0Pl3KgnwwNFJDaDlYeuhXuZdnjcRLNth3AnmuscKIrsmvuqoomTEPsLgGq1wpGo Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 1bab2edcfa684d8a8befcb705fe3990e Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:24:47.790150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1bab2edcfa684d8a8befcb705fe3990e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1bab2edcfa684d8a8befcb705fe3990e"}]}] Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 1bab2edcfa684d8a8befcb705fe3990e Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-492183407 Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-492183407-project Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 90d3b420b0f64c848c49b8149518e55e Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-492183407-project Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:47.791760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '174c5ef6-abf1-465c-afed-96d456b50c8e'} Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:24:47.792923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. Sep 19 17:24:47.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:24:47.795571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] Returning 404 to user: Instance 174c5ef6-abf1-465c-afed-96d456b50c8e could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:24:47.795571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-18ed5e85-f6f1-4ab8-8ae6-56888eca4488 tempest-DeleteServersTestJSON-492183407 tempest-DeleteServersTestJSON-492183407-project] 10.222.0.61 "GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e" status: 404 len: 111 microversion: 2.1 time: 0.034462 Sep 19 17:24:47.795571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 104/208] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:47 2022] GET /compute/v2.1/servers/174c5ef6-abf1-465c-afed-96d456b50c8e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 17:24:48.263741 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9995da55-d9e5-45c0-affd-d1d6f369fb48 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:48.264929 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9995da55-d9e5-45c0-affd-d1d6f369fb48 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:48.278040 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9995da55-d9e5-45c0-affd-d1d6f369fb48 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:48.282027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9995da55-d9e5-45c0-affd-d1d6f369fb48 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:48.282835 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9995da55-d9e5-45c0-affd-d1d6f369fb48 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:48.283664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9995da55-d9e5-45c0-affd-d1d6f369fb48 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:48.284168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9995da55-d9e5-45c0-affd-d1d6f369fb48 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:48.284673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9995da55-d9e5-45c0-affd-d1d6f369fb48 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:48.555477 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9995da55-d9e5-45c0-affd-d1d6f369fb48 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:48.564767 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d317c08f-c121-4413-9beb-d9bc1fd6a23c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:48.565666 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9995da55-d9e5-45c0-affd-d1d6f369fb48 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1313 microversion: 2.1 time: 0.306678 Sep 19 17:24:48.566718 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 105/209] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:48 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:48.567008 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d317c08f-c121-4413-9beb-d9bc1fd6a23c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:48.574581 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d317c08f-c121-4413-9beb-d9bc1fd6a23c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:48.575073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d317c08f-c121-4413-9beb-d9bc1fd6a23c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:48.575535 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d317c08f-c121-4413-9beb-d9bc1fd6a23c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:48.576435 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d317c08f-c121-4413-9beb-d9bc1fd6a23c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:48.576897 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d317c08f-c121-4413-9beb-d9bc1fd6a23c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:48.577328 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d317c08f-c121-4413-9beb-d9bc1fd6a23c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:48.820282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d317c08f-c121-4413-9beb-d9bc1fd6a23c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:48.830041 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d317c08f-c121-4413-9beb-d9bc1fd6a23c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.270596 Sep 19 17:24:48.830632 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 105/210] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:48 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:49.597263 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a86be64e-00ac-475b-9e55-079ba639f0e4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:49.598280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a86be64e-00ac-475b-9e55-079ba639f0e4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:49.612685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a86be64e-00ac-475b-9e55-079ba639f0e4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:49.614021 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a86be64e-00ac-475b-9e55-079ba639f0e4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:49.615116 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a86be64e-00ac-475b-9e55-079ba639f0e4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:49.616140 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a86be64e-00ac-475b-9e55-079ba639f0e4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:49.616837 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a86be64e-00ac-475b-9e55-079ba639f0e4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:49.617430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a86be64e-00ac-475b-9e55-079ba639f0e4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:49.860597 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2fbf5ce1-f52e-461c-ba75-dcf61dec39e1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:49.861421 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2fbf5ce1-f52e-461c-ba75-dcf61dec39e1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:49.871826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fbf5ce1-f52e-461c-ba75-dcf61dec39e1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:49.872319 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fbf5ce1-f52e-461c-ba75-dcf61dec39e1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:49.874474 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fbf5ce1-f52e-461c-ba75-dcf61dec39e1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:49.878645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fbf5ce1-f52e-461c-ba75-dcf61dec39e1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:49.883367 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fbf5ce1-f52e-461c-ba75-dcf61dec39e1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:49.883861 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fbf5ce1-f52e-461c-ba75-dcf61dec39e1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:50.031535 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a86be64e-00ac-475b-9e55-079ba639f0e4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:50.046560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a86be64e-00ac-475b-9e55-079ba639f0e4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1313 microversion: 2.1 time: 0.461282 Sep 19 17:24:50.058982 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 106/211] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:49 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:50.193440 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2fbf5ce1-f52e-461c-ba75-dcf61dec39e1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:50.202142 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2fbf5ce1-f52e-461c-ba75-dcf61dec39e1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.350947 Sep 19 17:24:50.214755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 106/212] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:49 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:51.072292 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d16d3a76-f0a0-44c5-a4dc-a2cacd80a1fb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:51.072946 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d16d3a76-f0a0-44c5-a4dc-a2cacd80a1fb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:51.078870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d16d3a76-f0a0-44c5-a4dc-a2cacd80a1fb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:51.079365 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d16d3a76-f0a0-44c5-a4dc-a2cacd80a1fb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:51.079816 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d16d3a76-f0a0-44c5-a4dc-a2cacd80a1fb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:51.080582 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d16d3a76-f0a0-44c5-a4dc-a2cacd80a1fb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:51.081034 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d16d3a76-f0a0-44c5-a4dc-a2cacd80a1fb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:51.081609 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d16d3a76-f0a0-44c5-a4dc-a2cacd80a1fb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:51.231055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14dbb821-4340-4d1f-ac87-f04a1c04d2d5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:51.231816 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14dbb821-4340-4d1f-ac87-f04a1c04d2d5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:51.239329 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14dbb821-4340-4d1f-ac87-f04a1c04d2d5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:51.239841 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14dbb821-4340-4d1f-ac87-f04a1c04d2d5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:51.240305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14dbb821-4340-4d1f-ac87-f04a1c04d2d5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:51.241271 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14dbb821-4340-4d1f-ac87-f04a1c04d2d5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:51.241754 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14dbb821-4340-4d1f-ac87-f04a1c04d2d5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:51.242177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14dbb821-4340-4d1f-ac87-f04a1c04d2d5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:51.262885 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d16d3a76-f0a0-44c5-a4dc-a2cacd80a1fb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:51.287192 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d16d3a76-f0a0-44c5-a4dc-a2cacd80a1fb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1313 microversion: 2.1 time: 0.218840 Sep 19 17:24:51.291287 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 107/213] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:51 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:51.488049 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-14dbb821-4340-4d1f-ac87-f04a1c04d2d5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:51.488049 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14dbb821-4340-4d1f-ac87-f04a1c04d2d5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.254821 Sep 19 17:24:51.488049 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 107/214] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:51 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:52.333075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77cdc94e-1efe-4dd3-8bdf-ba59ba7b5db4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:52.334201 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77cdc94e-1efe-4dd3-8bdf-ba59ba7b5db4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:52.350137 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cdc94e-1efe-4dd3-8bdf-ba59ba7b5db4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:52.353445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cdc94e-1efe-4dd3-8bdf-ba59ba7b5db4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:52.353445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cdc94e-1efe-4dd3-8bdf-ba59ba7b5db4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:52.353445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cdc94e-1efe-4dd3-8bdf-ba59ba7b5db4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:52.353445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cdc94e-1efe-4dd3-8bdf-ba59ba7b5db4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:52.353811 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cdc94e-1efe-4dd3-8bdf-ba59ba7b5db4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:52.511734 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9994ccf6-c078-4429-9ca1-15da05e47a7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:52.512662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9994ccf6-c078-4429-9ca1-15da05e47a7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:52.536458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9994ccf6-c078-4429-9ca1-15da05e47a7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:52.536963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9994ccf6-c078-4429-9ca1-15da05e47a7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:52.537405 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9994ccf6-c078-4429-9ca1-15da05e47a7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:52.538127 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9994ccf6-c078-4429-9ca1-15da05e47a7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:52.542857 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9994ccf6-c078-4429-9ca1-15da05e47a7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:52.549543 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9994ccf6-c078-4429-9ca1-15da05e47a7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:52.664388 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-77cdc94e-1efe-4dd3-8bdf-ba59ba7b5db4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:52.678261 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77cdc94e-1efe-4dd3-8bdf-ba59ba7b5db4 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1313 microversion: 2.1 time: 0.356974 Sep 19 17:24:52.681284 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 108/215] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:52 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:52.698133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b0a05a80-f0be-4793-83c0-88c60de60f85 req-4be6286f-f7b6-4484-b725-11a54871faf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6311f1a9-d9cd-411a-a3f2-0133fbfca6d9", "name": "network-vif-plugged", "status": "completed", "tag": "10c3ac96-1fd1-4d57-b5fb-360aecc85b11"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:24:52.734606 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b0a05a80-f0be-4793-83c0-88c60de60f85 req-4be6286f-f7b6-4484-b725-11a54871faf7 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:52.734606 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b0a05a80-f0be-4793-83c0-88c60de60f85 req-4be6286f-f7b6-4484-b725-11a54871faf7 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:52.734606 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b0a05a80-f0be-4793-83c0-88c60de60f85 req-4be6286f-f7b6-4484-b725-11a54871faf7 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:52.757452 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b0a05a80-f0be-4793-83c0-88c60de60f85 req-4be6286f-f7b6-4484-b725-11a54871faf7 service nova] Creating event network-vif-plugged:10c3ac96-1fd1-4d57-b5fb-360aecc85b11 for instance 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 on hv-cinder-84801 Sep 19 17:24:52.769971 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b0a05a80-f0be-4793-83c0-88c60de60f85 req-4be6286f-f7b6-4484-b725-11a54871faf7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084923 Sep 19 17:24:52.772692 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 109/216] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:24:52.913673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9994ccf6-c078-4429-9ca1-15da05e47a7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:52.920475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9994ccf6-c078-4429-9ca1-15da05e47a7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.415471 Sep 19 17:24:52.924936 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 108/217] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:52 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:53.704475 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc46659d-a780-448b-90e8-6c9c4e693c69 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:53.705180 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bc46659d-a780-448b-90e8-6c9c4e693c69 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:53.711882 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc46659d-a780-448b-90e8-6c9c4e693c69 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:53.713305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc46659d-a780-448b-90e8-6c9c4e693c69 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:53.713925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc46659d-a780-448b-90e8-6c9c4e693c69 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:53.714803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc46659d-a780-448b-90e8-6c9c4e693c69 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:53.715762 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc46659d-a780-448b-90e8-6c9c4e693c69 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:53.716354 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc46659d-a780-448b-90e8-6c9c4e693c69 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:53.950781 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7cad7e85-74fd-4589-8264-57f3343a4df2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:53.952641 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7cad7e85-74fd-4589-8264-57f3343a4df2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:53.963475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cad7e85-74fd-4589-8264-57f3343a4df2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:53.963475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cad7e85-74fd-4589-8264-57f3343a4df2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:53.963475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cad7e85-74fd-4589-8264-57f3343a4df2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:53.964539 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cad7e85-74fd-4589-8264-57f3343a4df2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:53.965261 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cad7e85-74fd-4589-8264-57f3343a4df2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:53.966114 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cad7e85-74fd-4589-8264-57f3343a4df2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:53.987929 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc46659d-a780-448b-90e8-6c9c4e693c69 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:54.001445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bc46659d-a780-448b-90e8-6c9c4e693c69 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1313 microversion: 2.1 time: 0.299504 Sep 19 17:24:54.002233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 110/218] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:53 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:54.183605 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7cad7e85-74fd-4589-8264-57f3343a4df2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:54.194923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7cad7e85-74fd-4589-8264-57f3343a4df2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.250849 Sep 19 17:24:54.195506 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 109/219] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:53 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:55.025402 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5d98695-617b-42fe-bcbf-0ecaa9553727 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:55.026020 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c5d98695-617b-42fe-bcbf-0ecaa9553727 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:55.032178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5d98695-617b-42fe-bcbf-0ecaa9553727 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:55.032654 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5d98695-617b-42fe-bcbf-0ecaa9553727 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:55.033210 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5d98695-617b-42fe-bcbf-0ecaa9553727 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:55.033918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5d98695-617b-42fe-bcbf-0ecaa9553727 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:55.034378 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5d98695-617b-42fe-bcbf-0ecaa9553727 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:55.034810 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5d98695-617b-42fe-bcbf-0ecaa9553727 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:55.171338 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c5d98695-617b-42fe-bcbf-0ecaa9553727 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:55.179153 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c5d98695-617b-42fe-bcbf-0ecaa9553727 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1313 microversion: 2.1 time: 0.158218 Sep 19 17:24:55.183281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 111/220] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:55 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:55.219126 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-763f4ce8-c5b5-4cdd-a563-b7c54982a805 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:55.219922 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-763f4ce8-c5b5-4cdd-a563-b7c54982a805 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:55.226650 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-763f4ce8-c5b5-4cdd-a563-b7c54982a805 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:55.227066 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-763f4ce8-c5b5-4cdd-a563-b7c54982a805 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:55.227507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-763f4ce8-c5b5-4cdd-a563-b7c54982a805 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:55.228248 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-763f4ce8-c5b5-4cdd-a563-b7c54982a805 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:55.228704 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-763f4ce8-c5b5-4cdd-a563-b7c54982a805 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:55.229148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-763f4ce8-c5b5-4cdd-a563-b7c54982a805 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:55.389637 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-763f4ce8-c5b5-4cdd-a563-b7c54982a805 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:55.397940 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-763f4ce8-c5b5-4cdd-a563-b7c54982a805 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.182732 Sep 19 17:24:55.398519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 110/221] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:55 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:56.202469 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a26f1afb-9ccc-485e-bc7f-528d7a94c890 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:56.203227 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a26f1afb-9ccc-485e-bc7f-528d7a94c890 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:56.209971 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26f1afb-9ccc-485e-bc7f-528d7a94c890 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:56.210704 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26f1afb-9ccc-485e-bc7f-528d7a94c890 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:56.211144 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26f1afb-9ccc-485e-bc7f-528d7a94c890 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:56.211921 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26f1afb-9ccc-485e-bc7f-528d7a94c890 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:56.212381 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26f1afb-9ccc-485e-bc7f-528d7a94c890 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:56.212911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26f1afb-9ccc-485e-bc7f-528d7a94c890 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:56.351676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a26f1afb-9ccc-485e-bc7f-528d7a94c890 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:56.360405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a26f1afb-9ccc-485e-bc7f-528d7a94c890 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1496 microversion: 2.1 time: 0.161954 Sep 19 17:24:56.360994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 112/222] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:56 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:56.421939 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-27797719-ead8-455f-a311-2c04665be016 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:56.426825 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-27797719-ead8-455f-a311-2c04665be016 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:56.429338 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27797719-ead8-455f-a311-2c04665be016 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:56.429833 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27797719-ead8-455f-a311-2c04665be016 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:56.430264 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27797719-ead8-455f-a311-2c04665be016 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:56.430994 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27797719-ead8-455f-a311-2c04665be016 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:56.431480 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27797719-ead8-455f-a311-2c04665be016 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:56.431929 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27797719-ead8-455f-a311-2c04665be016 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:56.565263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-27797719-ead8-455f-a311-2c04665be016 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:56.572986 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-27797719-ead8-455f-a311-2c04665be016 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.154943 Sep 19 17:24:56.573765 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 111/223] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:56 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:57.597285 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e75af128-ea04-4fd7-be8a-1135c1113484 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:57.598103 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e75af128-ea04-4fd7-be8a-1135c1113484 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:57.600158 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:24:57.605419 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e75af128-ea04-4fd7-be8a-1135c1113484 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:57.606311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e75af128-ea04-4fd7-be8a-1135c1113484 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:57.606430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e75af128-ea04-4fd7-be8a-1135c1113484 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:57.607335 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e75af128-ea04-4fd7-be8a-1135c1113484 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:57.607822 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e75af128-ea04-4fd7-be8a-1135c1113484 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:57.608254 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e75af128-ea04-4fd7-be8a-1135c1113484 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:57.834990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e75af128-ea04-4fd7-be8a-1135c1113484 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:57.864378 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e75af128-ea04-4fd7-be8a-1135c1113484 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.270624 Sep 19 17:24:57.865361 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 113/224] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:57 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:57.915041 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6169ae8-cc52-4894-81db-38b35e05879c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:57.916201 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6169ae8-cc52-4894-81db-38b35e05879c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:57.925865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6169ae8-cc52-4894-81db-38b35e05879c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:57.925865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6169ae8-cc52-4894-81db-38b35e05879c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:57.925865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6169ae8-cc52-4894-81db-38b35e05879c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:57.925865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6169ae8-cc52-4894-81db-38b35e05879c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:57.926268 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6169ae8-cc52-4894-81db-38b35e05879c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:57.926268 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6169ae8-cc52-4894-81db-38b35e05879c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:57.959597 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6169ae8-cc52-4894-81db-38b35e05879c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:24:58.348489 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6169ae8-cc52-4894-81db-38b35e05879c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 204 len: 0 microversion: 2.1 time: 0.442633 Sep 19 17:24:58.349372 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 112/225] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:24:57 2022] DELETE /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:24:58.358312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-85d17fbe-73ea-4904-93b0-dcb93207e8e2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:58.359526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-85d17fbe-73ea-4904-93b0-dcb93207e8e2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:58.365985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d17fbe-73ea-4904-93b0-dcb93207e8e2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:58.366699 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d17fbe-73ea-4904-93b0-dcb93207e8e2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:58.367283 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d17fbe-73ea-4904-93b0-dcb93207e8e2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:58.368405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d17fbe-73ea-4904-93b0-dcb93207e8e2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:58.369491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d17fbe-73ea-4904-93b0-dcb93207e8e2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:58.370050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d17fbe-73ea-4904-93b0-dcb93207e8e2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:58.402723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-913338710", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "networks": [{"uuid": "7d1d32ac-68b4-4010-b266-e123719339b9"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:24:58.461867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] validate_networks() for [('7d1d32ac-68b4-4010-b266-e123719339b9', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:24:58.886068 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-85d17fbe-73ea-4904-93b0-dcb93207e8e2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:58.898422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-85d17fbe-73ea-4904-93b0-dcb93207e8e2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1502 microversion: 2.1 time: 0.544044 Sep 19 17:24:58.901618 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 114/226] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:58 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1502 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:58.908309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d00dde02-127f-47c9-afa1-a6876ff2d710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:58.925684 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d00dde02-127f-47c9-afa1-a6876ff2d710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:58.936519 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00dde02-127f-47c9-afa1-a6876ff2d710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:58.937130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00dde02-127f-47c9-afa1-a6876ff2d710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:58.937771 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00dde02-127f-47c9-afa1-a6876ff2d710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:58.938657 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00dde02-127f-47c9-afa1-a6876ff2d710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:58.939456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00dde02-127f-47c9-afa1-a6876ff2d710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:58.940108 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00dde02-127f-47c9-afa1-a6876ff2d710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:59.324194 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d00dde02-127f-47c9-afa1-a6876ff2d710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:59.337171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d00dde02-127f-47c9-afa1-a6876ff2d710 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.432671 Sep 19 17:24:59.337764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 115/227] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:58 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:24:59.526357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:24:59.527608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:24:59.528343 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:24:59.528972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:24:59.529641 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:24:59.542702 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:59.543287 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:59.543633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:59.544470 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:59.544941 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:59.545638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:59.569829 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Getting quotas for project 6198c6cbed294d0eb4ef8fcd97ba96fe. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:24:59.574767 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Getting quotas for user 74a2c7317c61405e8c9e9118286be69d and project 6198c6cbed294d0eb4ef8fcd97ba96fe. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:24:59.585519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:24:59.590705 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:24:59.793715 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dbd41304-17ac-4adc-8b21-7a034354b846 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.395210 Sep 19 17:24:59.795118 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 113/228] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:24:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:24:59.806530 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b4d11b95-5036-4e91-97d1-9d77b8d73e6c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:59.808312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b4d11b95-5036-4e91-97d1-9d77b8d73e6c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:59.898345 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b4d11b95-5036-4e91-97d1-9d77b8d73e6c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:24:59.918759 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b4d11b95-5036-4e91-97d1-9d77b8d73e6c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1218 microversion: 2.1 time: 0.116584 Sep 19 17:24:59.924582 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e1b19831-a26d-45d5-b4dc-ea6ff0663551 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:24:59.925197 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e1b19831-a26d-45d5-b4dc-ea6ff0663551 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:24:59.933121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 116/229] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:59 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:24:59.937639 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b19831-a26d-45d5-b4dc-ea6ff0663551 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:59.941922 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b19831-a26d-45d5-b4dc-ea6ff0663551 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:59.943534 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b19831-a26d-45d5-b4dc-ea6ff0663551 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:24:59.954847 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b19831-a26d-45d5-b4dc-ea6ff0663551 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:24:59.959242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b19831-a26d-45d5-b4dc-ea6ff0663551 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:24:59.961390 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b19831-a26d-45d5-b4dc-ea6ff0663551 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:00.145849 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e1b19831-a26d-45d5-b4dc-ea6ff0663551 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:00.156503 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e1b19831-a26d-45d5-b4dc-ea6ff0663551 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1502 microversion: 2.1 time: 0.236102 Sep 19 17:25:00.157098 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 114/230] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:24:59 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1502 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:00.361149 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-061cce03-ac75-41f1-b8be-ed060ac941e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:00.361775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-061cce03-ac75-41f1-b8be-ed060ac941e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:00.370733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-061cce03-ac75-41f1-b8be-ed060ac941e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:00.373851 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-061cce03-ac75-41f1-b8be-ed060ac941e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:00.374338 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-061cce03-ac75-41f1-b8be-ed060ac941e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:00.375087 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-061cce03-ac75-41f1-b8be-ed060ac941e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:00.377909 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-061cce03-ac75-41f1-b8be-ed060ac941e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:00.378550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-061cce03-ac75-41f1-b8be-ed060ac941e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:00.592951 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-061cce03-ac75-41f1-b8be-ed060ac941e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:00.602182 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-061cce03-ac75-41f1-b8be-ed060ac941e4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.245495 Sep 19 17:25:00.603309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 117/231] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:00 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:00.959237 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af1345cf-dfea-4d04-98bb-e459cb5af984 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:00.960662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af1345cf-dfea-4d04-98bb-e459cb5af984 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:01.034799 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-af1345cf-dfea-4d04-98bb-e459cb5af984 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:01.043830 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af1345cf-dfea-4d04-98bb-e459cb5af984 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1218 microversion: 2.1 time: 0.089033 Sep 19 17:25:01.045032 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 115/232] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:00 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:01.179244 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3366df2b-f208-4f31-a0db-ae9abde9aa82 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:01.180190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3366df2b-f208-4f31-a0db-ae9abde9aa82 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:01.187373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3366df2b-f208-4f31-a0db-ae9abde9aa82 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:01.188123 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3366df2b-f208-4f31-a0db-ae9abde9aa82 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:01.188558 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3366df2b-f208-4f31-a0db-ae9abde9aa82 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:01.189255 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3366df2b-f208-4f31-a0db-ae9abde9aa82 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:01.189703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3366df2b-f208-4f31-a0db-ae9abde9aa82 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:01.190324 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3366df2b-f208-4f31-a0db-ae9abde9aa82 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:01.338613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3366df2b-f208-4f31-a0db-ae9abde9aa82 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:01.349376 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3366df2b-f208-4f31-a0db-ae9abde9aa82 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1502 microversion: 2.1 time: 0.173935 Sep 19 17:25:01.349960 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 118/233] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:01 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:01.633323 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-456e25ee-74c6-476e-84e2-7c6fd51c2cf6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:01.635407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-456e25ee-74c6-476e-84e2-7c6fd51c2cf6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:01.649780 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e25ee-74c6-476e-84e2-7c6fd51c2cf6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:01.650076 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e25ee-74c6-476e-84e2-7c6fd51c2cf6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:01.650518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e25ee-74c6-476e-84e2-7c6fd51c2cf6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:01.651230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e25ee-74c6-476e-84e2-7c6fd51c2cf6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:01.654704 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e25ee-74c6-476e-84e2-7c6fd51c2cf6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:01.655027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e25ee-74c6-476e-84e2-7c6fd51c2cf6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:01.842978 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-456e25ee-74c6-476e-84e2-7c6fd51c2cf6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:01.871152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-456e25ee-74c6-476e-84e2-7c6fd51c2cf6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.245052 Sep 19 17:25:01.871152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 116/234] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:01 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:02.073840 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-15816192-373b-47ea-be0f-5b59a5491ec9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:02.074462 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-15816192-373b-47ea-be0f-5b59a5491ec9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:02.089534 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15816192-373b-47ea-be0f-5b59a5491ec9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:02.090269 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15816192-373b-47ea-be0f-5b59a5491ec9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:02.090721 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15816192-373b-47ea-be0f-5b59a5491ec9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:02.091449 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15816192-373b-47ea-be0f-5b59a5491ec9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:02.091949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15816192-373b-47ea-be0f-5b59a5491ec9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:02.092379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15816192-373b-47ea-be0f-5b59a5491ec9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:02.119432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:02.184615 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-15816192-373b-47ea-be0f-5b59a5491ec9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:02.193018 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-15816192-373b-47ea-be0f-5b59a5491ec9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1222 microversion: 2.1 time: 0.125849 Sep 19 17:25:02.194187 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 119/235] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:02 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:02.374648 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53070123-0948-401c-a43d-e8f499f38e31 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:02.375271 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53070123-0948-401c-a43d-e8f499f38e31 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:02.382322 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53070123-0948-401c-a43d-e8f499f38e31 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:02.382822 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53070123-0948-401c-a43d-e8f499f38e31 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:02.383268 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53070123-0948-401c-a43d-e8f499f38e31 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:02.384001 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53070123-0948-401c-a43d-e8f499f38e31 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:02.384466 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53070123-0948-401c-a43d-e8f499f38e31 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:02.384892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53070123-0948-401c-a43d-e8f499f38e31 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:02.448743 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5fef21b6-f76e-44be-b305-4538fb26a1f2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Action: 'create', calling method: .version_select at 0x7fd4d613ae50>, body: {"keypair": {"name": "tempest-keypair-606628555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZZgp64MCrIy1ccwQf8DUu5WHcw8DXKAttdaQ2CEUkEtUGBmD4xOYBM/opnc/tSPRiV7jfBeY1iYmkZMeQHVpWwsKlMb3Cr7GBUcOkGJ3ljriKVw7Qjmmnn/Bht1+h6yA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:02.476638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-5fef21b6-f76e-44be-b305-4538fb26a1f2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Getting quotas for project 4225a4c3567f43208ad1663eec41c56d. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:25:02.482107 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-5fef21b6-f76e-44be-b305-4538fb26a1f2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Getting quotas for user 69e1832300e44d20be53e84933b97faa and project 4225a4c3567f43208ad1663eec41c56d. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:25:02.545276 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-53070123-0948-401c-a43d-e8f499f38e31 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:02.568796 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53070123-0948-401c-a43d-e8f499f38e31 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1502 microversion: 2.1 time: 0.198581 Sep 19 17:25:02.572502 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 120/236] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:02 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1502 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:02.629746 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5fef21b6-f76e-44be-b305-4538fb26a1f2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.321935 Sep 19 17:25:02.634870 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 117/237] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Sep 19 17:25:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:25:02.892975 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d1b60916-f286-4040-bbba-13cf1020cf66 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:02.894307 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d1b60916-f286-4040-bbba-13cf1020cf66 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:02.901185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b60916-f286-4040-bbba-13cf1020cf66 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:02.901678 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b60916-f286-4040-bbba-13cf1020cf66 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:02.902117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b60916-f286-4040-bbba-13cf1020cf66 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:02.902824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b60916-f286-4040-bbba-13cf1020cf66 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:02.903279 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b60916-f286-4040-bbba-13cf1020cf66 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:02.903941 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b60916-f286-4040-bbba-13cf1020cf66 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:03.053140 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d1b60916-f286-4040-bbba-13cf1020cf66 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:03.061553 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d1b60916-f286-4040-bbba-13cf1020cf66 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.172375 Sep 19 17:25:03.062148 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 121/238] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:02 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:03.217197 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31792cad-de39-4062-a430-35eb1e8bb14f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:03.217853 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31792cad-de39-4062-a430-35eb1e8bb14f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:03.224457 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31792cad-de39-4062-a430-35eb1e8bb14f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:03.224937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31792cad-de39-4062-a430-35eb1e8bb14f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:03.225369 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31792cad-de39-4062-a430-35eb1e8bb14f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:03.226051 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31792cad-de39-4062-a430-35eb1e8bb14f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:03.226497 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31792cad-de39-4062-a430-35eb1e8bb14f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:03.226917 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31792cad-de39-4062-a430-35eb1e8bb14f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:03.288952 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-31792cad-de39-4062-a430-35eb1e8bb14f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:03.297129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31792cad-de39-4062-a430-35eb1e8bb14f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1222 microversion: 2.1 time: 0.083959 Sep 19 17:25:03.297691 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 118/239] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:03 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:03.595526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42b3a612-70a4-4036-b3a7-7a90dabac61c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:03.603076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-42b3a612-70a4-4036-b3a7-7a90dabac61c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:03.603076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42b3a612-70a4-4036-b3a7-7a90dabac61c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:03.603076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42b3a612-70a4-4036-b3a7-7a90dabac61c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:03.603435 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42b3a612-70a4-4036-b3a7-7a90dabac61c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:03.603881 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42b3a612-70a4-4036-b3a7-7a90dabac61c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:03.604281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42b3a612-70a4-4036-b3a7-7a90dabac61c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:03.604701 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42b3a612-70a4-4036-b3a7-7a90dabac61c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:03.757613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-42b3a612-70a4-4036-b3a7-7a90dabac61c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:03.767515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42b3a612-70a4-4036-b3a7-7a90dabac61c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1502 microversion: 2.1 time: 0.175722 Sep 19 17:25:03.768188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 122/240] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:03 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:04.088359 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a0e49e8-8cd1-4a78-8bf7-959d52010e94 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:04.090073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6a0e49e8-8cd1-4a78-8bf7-959d52010e94 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:04.099607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a0e49e8-8cd1-4a78-8bf7-959d52010e94 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:04.100414 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a0e49e8-8cd1-4a78-8bf7-959d52010e94 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:04.101019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a0e49e8-8cd1-4a78-8bf7-959d52010e94 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:04.102390 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a0e49e8-8cd1-4a78-8bf7-959d52010e94 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:04.103912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a0e49e8-8cd1-4a78-8bf7-959d52010e94 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:04.106532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a0e49e8-8cd1-4a78-8bf7-959d52010e94 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:04.262225 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a0e49e8-8cd1-4a78-8bf7-959d52010e94 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:04.275332 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a0e49e8-8cd1-4a78-8bf7-959d52010e94 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.192701 Sep 19 17:25:04.276619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 119/241] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:04 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:04.321803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e741f02-0ac7-44c1-a8fa-6342452ef9a6 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:04.322697 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e741f02-0ac7-44c1-a8fa-6342452ef9a6 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:04.329175 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e741f02-0ac7-44c1-a8fa-6342452ef9a6 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:04.329996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e741f02-0ac7-44c1-a8fa-6342452ef9a6 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:04.335313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e741f02-0ac7-44c1-a8fa-6342452ef9a6 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:04.335313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e741f02-0ac7-44c1-a8fa-6342452ef9a6 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:04.335313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e741f02-0ac7-44c1-a8fa-6342452ef9a6 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:04.335313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e741f02-0ac7-44c1-a8fa-6342452ef9a6 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:04.401464 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2e741f02-0ac7-44c1-a8fa-6342452ef9a6 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:04.409608 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e741f02-0ac7-44c1-a8fa-6342452ef9a6 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1222 microversion: 2.1 time: 0.093767 Sep 19 17:25:04.410179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 123/242] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:04 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:04.796120 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65a3637d-2cc5-43a7-bcfe-609c90d64ded tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:04.796811 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-65a3637d-2cc5-43a7-bcfe-609c90d64ded tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:04.809839 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65a3637d-2cc5-43a7-bcfe-609c90d64ded tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:04.810583 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65a3637d-2cc5-43a7-bcfe-609c90d64ded tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:04.811659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65a3637d-2cc5-43a7-bcfe-609c90d64ded tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:04.812475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65a3637d-2cc5-43a7-bcfe-609c90d64ded tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:04.813010 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65a3637d-2cc5-43a7-bcfe-609c90d64ded tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:04.813644 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65a3637d-2cc5-43a7-bcfe-609c90d64ded tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:04.953732 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-65a3637d-2cc5-43a7-bcfe-609c90d64ded tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:04.957796 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:04.962952 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-65a3637d-2cc5-43a7-bcfe-609c90d64ded tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1502 microversion: 2.1 time: 0.175970 Sep 19 17:25:04.963530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 120/243] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:04 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:04.989217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-659969139", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63313b22-203d-445f-8d13-359752f5c140"}], "security_groups": [{"name": "tempest-securitygroup--1180507037"}], "key_name": "tempest-keypair-606628555", "user_data": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:05.096459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] validate_networks() for [('63313b22-203d-445f-8d13-359752f5c140', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:25:05.300533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-361f3b14-25af-457f-a4a7-2fbdcf5c28db tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:05.301912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-361f3b14-25af-457f-a4a7-2fbdcf5c28db tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:05.309566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-361f3b14-25af-457f-a4a7-2fbdcf5c28db tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:05.310111 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-361f3b14-25af-457f-a4a7-2fbdcf5c28db tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:05.310558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-361f3b14-25af-457f-a4a7-2fbdcf5c28db tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:05.311269 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-361f3b14-25af-457f-a4a7-2fbdcf5c28db tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:05.311763 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-361f3b14-25af-457f-a4a7-2fbdcf5c28db tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:05.312442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-361f3b14-25af-457f-a4a7-2fbdcf5c28db tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:05.551619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-361f3b14-25af-457f-a4a7-2fbdcf5c28db tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:05.566384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-361f3b14-25af-457f-a4a7-2fbdcf5c28db tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.271418 Sep 19 17:25:05.567302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 121/244] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:05 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:05.573093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6b43995d-1c58-44e8-9183-dca9ce69e089 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:05.573861 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6b43995d-1c58-44e8-9183-dca9ce69e089 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:05.580610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b43995d-1c58-44e8-9183-dca9ce69e089 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:05.581345 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b43995d-1c58-44e8-9183-dca9ce69e089 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:05.582006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b43995d-1c58-44e8-9183-dca9ce69e089 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:05.582974 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b43995d-1c58-44e8-9183-dca9ce69e089 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:05.583553 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b43995d-1c58-44e8-9183-dca9ce69e089 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:05.584167 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b43995d-1c58-44e8-9183-dca9ce69e089 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:05.598125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:25:05.598548 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:25:05.599021 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:25:05.599430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:25:05.599874 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:25:05.609965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:05.610616 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:05.611064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:05.611841 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:05.612301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:05.612727 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:05.632605 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Getting quotas for project 4225a4c3567f43208ad1663eec41c56d. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:25:05.636833 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Getting quotas for user 69e1832300e44d20be53e84933b97faa and project 4225a4c3567f43208ad1663eec41c56d. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:25:05.652066 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6b43995d-1c58-44e8-9183-dca9ce69e089 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:05.652728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:25:05.655244 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:25:05.662211 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6b43995d-1c58-44e8-9183-dca9ce69e089 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1222 microversion: 2.1 time: 0.093342 Sep 19 17:25:05.663286 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 122/245] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:05 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:05.815857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6873c48e-81a4-4324-994e-ecc07709cdc8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.829239 Sep 19 17:25:05.815857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 124/246] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:25:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:25:05.827177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-df980d48-3760-4d3e-887d-aae72e5931fd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:05.827886 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-df980d48-3760-4d3e-887d-aae72e5931fd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:05.903684 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-df980d48-3760-4d3e-887d-aae72e5931fd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:05.911298 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-df980d48-3760-4d3e-887d-aae72e5931fd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1236 microversion: 2.1 time: 0.087863 Sep 19 17:25:05.912289 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 123/247] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:05 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:05.987799 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-79d07c1f-735c-4d21-9f87-7baa344da5fd tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:05.987799 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-79d07c1f-735c-4d21-9f87-7baa344da5fd tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:05.996331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79d07c1f-735c-4d21-9f87-7baa344da5fd tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:05.996895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79d07c1f-735c-4d21-9f87-7baa344da5fd tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:05.997310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79d07c1f-735c-4d21-9f87-7baa344da5fd tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:05.998034 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79d07c1f-735c-4d21-9f87-7baa344da5fd tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:05.998802 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79d07c1f-735c-4d21-9f87-7baa344da5fd tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:05.999253 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79d07c1f-735c-4d21-9f87-7baa344da5fd tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:06.150812 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-79d07c1f-735c-4d21-9f87-7baa344da5fd tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:06.159508 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-79d07c1f-735c-4d21-9f87-7baa344da5fd tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1502 microversion: 2.1 time: 0.176779 Sep 19 17:25:06.160222 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 125/248] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:05 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:06.590117 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f0d27f51-28db-48ea-9afa-14689a9a949c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:06.590730 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f0d27f51-28db-48ea-9afa-14689a9a949c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:06.597202 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0d27f51-28db-48ea-9afa-14689a9a949c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:06.597716 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0d27f51-28db-48ea-9afa-14689a9a949c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:06.598301 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0d27f51-28db-48ea-9afa-14689a9a949c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:06.598999 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0d27f51-28db-48ea-9afa-14689a9a949c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:06.599461 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0d27f51-28db-48ea-9afa-14689a9a949c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:06.599931 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0d27f51-28db-48ea-9afa-14689a9a949c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:06.685920 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c7ea971d-bda8-4a21-b5e3-c9a70d1df7e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:06.686540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c7ea971d-bda8-4a21-b5e3-c9a70d1df7e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:06.693069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7ea971d-bda8-4a21-b5e3-c9a70d1df7e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:06.693642 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7ea971d-bda8-4a21-b5e3-c9a70d1df7e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:06.694147 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7ea971d-bda8-4a21-b5e3-c9a70d1df7e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:06.694939 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7ea971d-bda8-4a21-b5e3-c9a70d1df7e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:06.695540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7ea971d-bda8-4a21-b5e3-c9a70d1df7e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:06.696000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7ea971d-bda8-4a21-b5e3-c9a70d1df7e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:06.752354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f0d27f51-28db-48ea-9afa-14689a9a949c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:06.763487 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f0d27f51-28db-48ea-9afa-14689a9a949c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.176814 Sep 19 17:25:06.765082 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 124/249] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:06 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:06.768126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c7ea971d-bda8-4a21-b5e3-c9a70d1df7e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:06.776876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c7ea971d-bda8-4a21-b5e3-c9a70d1df7e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1222 microversion: 2.1 time: 0.095227 Sep 19 17:25:06.777662 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 126/250] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:06 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:06.935740 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5bf969b0-7b9a-4980-b1bb-6c2643e959c6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:06.936277 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5bf969b0-7b9a-4980-b1bb-6c2643e959c6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:06.991595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5bf969b0-7b9a-4980-b1bb-6c2643e959c6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:06.998573 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5bf969b0-7b9a-4980-b1bb-6c2643e959c6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1236 microversion: 2.1 time: 0.066749 Sep 19 17:25:06.999148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 125/251] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:06 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:07.183189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-428bc0ee-4078-4141-91b1-72088d7b6747 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:07.183825 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-428bc0ee-4078-4141-91b1-72088d7b6747 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:07.190151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-428bc0ee-4078-4141-91b1-72088d7b6747 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:07.190580 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-428bc0ee-4078-4141-91b1-72088d7b6747 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:07.191162 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-428bc0ee-4078-4141-91b1-72088d7b6747 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:07.191889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-428bc0ee-4078-4141-91b1-72088d7b6747 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:07.192355 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-428bc0ee-4078-4141-91b1-72088d7b6747 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:07.192785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-428bc0ee-4078-4141-91b1-72088d7b6747 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:07.330429 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-428bc0ee-4078-4141-91b1-72088d7b6747 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:07.338301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-428bc0ee-4078-4141-91b1-72088d7b6747 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1502 microversion: 2.1 time: 0.159074 Sep 19 17:25:07.339453 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 127/252] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:07 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:07.788114 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-308e77df-0bd7-40d2-acb0-dc9ec4bde250 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:07.789004 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-308e77df-0bd7-40d2-acb0-dc9ec4bde250 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:07.796688 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-308e77df-0bd7-40d2-acb0-dc9ec4bde250 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:07.797371 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-308e77df-0bd7-40d2-acb0-dc9ec4bde250 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:07.798002 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-308e77df-0bd7-40d2-acb0-dc9ec4bde250 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:07.798880 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-308e77df-0bd7-40d2-acb0-dc9ec4bde250 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:07.799478 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-308e77df-0bd7-40d2-acb0-dc9ec4bde250 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:07.800100 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-308e77df-0bd7-40d2-acb0-dc9ec4bde250 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:07.803709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4df072c8-a9bc-4975-bfbf-4d4ed65a0656 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:07.804395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4df072c8-a9bc-4975-bfbf-4d4ed65a0656 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:07.811592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4df072c8-a9bc-4975-bfbf-4d4ed65a0656 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:07.812164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4df072c8-a9bc-4975-bfbf-4d4ed65a0656 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:07.812684 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4df072c8-a9bc-4975-bfbf-4d4ed65a0656 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:07.813598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4df072c8-a9bc-4975-bfbf-4d4ed65a0656 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:07.814136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4df072c8-a9bc-4975-bfbf-4d4ed65a0656 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:07.814662 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4df072c8-a9bc-4975-bfbf-4d4ed65a0656 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:07.904448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4df072c8-a9bc-4975-bfbf-4d4ed65a0656 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:07.912435 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4df072c8-a9bc-4975-bfbf-4d4ed65a0656 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1270 microversion: 2.1 time: 0.114909 Sep 19 17:25:07.913152 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 128/253] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:07 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:07.986062 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-308e77df-0bd7-40d2-acb0-dc9ec4bde250 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:07.998887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-308e77df-0bd7-40d2-acb0-dc9ec4bde250 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.214558 Sep 19 17:25:07.999652 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 126/254] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:07 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:08.021216 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f8f16c9-4a6d-4bb3-b72a-77b953b7d51d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:08.021832 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0f8f16c9-4a6d-4bb3-b72a-77b953b7d51d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:08.027680 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f8f16c9-4a6d-4bb3-b72a-77b953b7d51d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:08.028234 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f8f16c9-4a6d-4bb3-b72a-77b953b7d51d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:08.028696 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f8f16c9-4a6d-4bb3-b72a-77b953b7d51d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:08.029454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f8f16c9-4a6d-4bb3-b72a-77b953b7d51d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:08.029921 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f8f16c9-4a6d-4bb3-b72a-77b953b7d51d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:08.030803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f8f16c9-4a6d-4bb3-b72a-77b953b7d51d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:08.092893 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0f8f16c9-4a6d-4bb3-b72a-77b953b7d51d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:08.101624 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f8f16c9-4a6d-4bb3-b72a-77b953b7d51d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1232 microversion: 2.1 time: 0.084578 Sep 19 17:25:08.102201 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 129/255] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:08 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1232 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:08.362387 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1eb9eac2-8629-4411-8f37-02ac1fd784b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:08.363540 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1eb9eac2-8629-4411-8f37-02ac1fd784b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:08.369928 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb9eac2-8629-4411-8f37-02ac1fd784b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:08.370423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb9eac2-8629-4411-8f37-02ac1fd784b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:08.371097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb9eac2-8629-4411-8f37-02ac1fd784b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:08.372027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb9eac2-8629-4411-8f37-02ac1fd784b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:08.372488 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb9eac2-8629-4411-8f37-02ac1fd784b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:08.373472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb9eac2-8629-4411-8f37-02ac1fd784b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:08.693862 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1eb9eac2-8629-4411-8f37-02ac1fd784b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:08.702017 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1eb9eac2-8629-4411-8f37-02ac1fd784b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1502 microversion: 2.1 time: 0.343419 Sep 19 17:25:08.702622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 127/256] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:08 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1502 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:08.938254 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d8db68f9-c6ce-4620-8e3a-3b2db8af925b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:08.938885 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d8db68f9-c6ce-4620-8e3a-3b2db8af925b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:08.944812 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8db68f9-c6ce-4620-8e3a-3b2db8af925b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:08.945295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8db68f9-c6ce-4620-8e3a-3b2db8af925b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:08.945734 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8db68f9-c6ce-4620-8e3a-3b2db8af925b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:08.946424 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8db68f9-c6ce-4620-8e3a-3b2db8af925b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:08.946874 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8db68f9-c6ce-4620-8e3a-3b2db8af925b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:08.947298 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8db68f9-c6ce-4620-8e3a-3b2db8af925b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:09.009171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d8db68f9-c6ce-4620-8e3a-3b2db8af925b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:09.033776 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d8db68f9-c6ce-4620-8e3a-3b2db8af925b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1278 microversion: 2.1 time: 0.089253 Sep 19 17:25:09.034015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9c48ab7-05fd-475d-bd9c-c1db78e38ca8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:09.034015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d9c48ab7-05fd-475d-bd9c-c1db78e38ca8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:09.034523 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 130/257] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:08 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:09.034612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9c48ab7-05fd-475d-bd9c-c1db78e38ca8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:09.034612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9c48ab7-05fd-475d-bd9c-c1db78e38ca8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:09.034612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9c48ab7-05fd-475d-bd9c-c1db78e38ca8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:09.034612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9c48ab7-05fd-475d-bd9c-c1db78e38ca8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:09.034935 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9c48ab7-05fd-475d-bd9c-c1db78e38ca8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:09.034935 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9c48ab7-05fd-475d-bd9c-c1db78e38ca8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:09.130930 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b115605-27ff-4d50-83dd-6233027637e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:09.132114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b115605-27ff-4d50-83dd-6233027637e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:09.138872 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b115605-27ff-4d50-83dd-6233027637e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:09.142754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b115605-27ff-4d50-83dd-6233027637e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:09.142754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b115605-27ff-4d50-83dd-6233027637e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:09.143450 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b115605-27ff-4d50-83dd-6233027637e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:09.144268 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b115605-27ff-4d50-83dd-6233027637e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:09.144774 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b115605-27ff-4d50-83dd-6233027637e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:09.186908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9c48ab7-05fd-475d-bd9c-c1db78e38ca8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:09.196160 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9c48ab7-05fd-475d-bd9c-c1db78e38ca8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.176723 Sep 19 17:25:09.199142 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 128/258] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:09 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:09.242595 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b115605-27ff-4d50-83dd-6233027637e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:09.263949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b115605-27ff-4d50-83dd-6233027637e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1288 microversion: 2.1 time: 0.136056 Sep 19 17:25:09.266056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 131/259] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:09 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1288 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:09.725558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eabe54d8-fdc4-4916-91c9-90ebc58052a2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:09.726338 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eabe54d8-fdc4-4916-91c9-90ebc58052a2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:09.728310 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:09.734151 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eabe54d8-fdc4-4916-91c9-90ebc58052a2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:09.734644 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eabe54d8-fdc4-4916-91c9-90ebc58052a2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:09.735082 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eabe54d8-fdc4-4916-91c9-90ebc58052a2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:09.735843 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eabe54d8-fdc4-4916-91c9-90ebc58052a2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:09.736300 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eabe54d8-fdc4-4916-91c9-90ebc58052a2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:09.736871 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eabe54d8-fdc4-4916-91c9-90ebc58052a2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:09.972760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-eabe54d8-fdc4-4916-91c9-90ebc58052a2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:09.972760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eabe54d8-fdc4-4916-91c9-90ebc58052a2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1460 microversion: 2.1 time: 0.249716 Sep 19 17:25:09.972760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 129/260] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:09 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1460 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:10.047128 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6dc0c6e-2f90-4fd6-b997-e98c993863d4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:10.047874 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6dc0c6e-2f90-4fd6-b997-e98c993863d4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:10.054119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6dc0c6e-2f90-4fd6-b997-e98c993863d4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:10.054601 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6dc0c6e-2f90-4fd6-b997-e98c993863d4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:10.055067 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6dc0c6e-2f90-4fd6-b997-e98c993863d4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:10.055773 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6dc0c6e-2f90-4fd6-b997-e98c993863d4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:10.056227 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6dc0c6e-2f90-4fd6-b997-e98c993863d4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:10.056649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6dc0c6e-2f90-4fd6-b997-e98c993863d4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:10.099318 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-91f1b3c1-bc7e-4254-86c3-d25ce860547e req-49687339-329b-4934-bbf0-b8f88278a80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6311f1a9-d9cd-411a-a3f2-0133fbfca6d9", "name": "network-vif-deleted", "tag": "10c3ac96-1fd1-4d57-b5fb-360aecc85b11"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:10.119370 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-91f1b3c1-bc7e-4254-86c3-d25ce860547e req-49687339-329b-4934-bbf0-b8f88278a80b service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:10.119919 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-91f1b3c1-bc7e-4254-86c3-d25ce860547e req-49687339-329b-4934-bbf0-b8f88278a80b service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:10.120346 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-91f1b3c1-bc7e-4254-86c3-d25ce860547e req-49687339-329b-4934-bbf0-b8f88278a80b service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:10.138916 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-91f1b3c1-bc7e-4254-86c3-d25ce860547e req-49687339-329b-4934-bbf0-b8f88278a80b service nova] Creating event network-vif-deleted:10c3ac96-1fd1-4d57-b5fb-360aecc85b11 for instance 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 on hv-cinder-84801 Sep 19 17:25:10.140532 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6dc0c6e-2f90-4fd6-b997-e98c993863d4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:10.147716 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-91f1b3c1-bc7e-4254-86c3-d25ce860547e req-49687339-329b-4934-bbf0-b8f88278a80b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051716 Sep 19 17:25:10.148498 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 130/261] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:25:10.149958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6dc0c6e-2f90-4fd6-b997-e98c993863d4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1276 microversion: 2.1 time: 0.106970 Sep 19 17:25:10.151668 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 132/262] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:10 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:10.225092 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebfd98d7-f8d1-430e-b8f0-2bc8e79abe50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:10.225857 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ebfd98d7-f8d1-430e-b8f0-2bc8e79abe50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:10.232138 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebfd98d7-f8d1-430e-b8f0-2bc8e79abe50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:10.232725 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebfd98d7-f8d1-430e-b8f0-2bc8e79abe50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:10.233235 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebfd98d7-f8d1-430e-b8f0-2bc8e79abe50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:10.234001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebfd98d7-f8d1-430e-b8f0-2bc8e79abe50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:10.234564 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebfd98d7-f8d1-430e-b8f0-2bc8e79abe50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:10.235062 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebfd98d7-f8d1-430e-b8f0-2bc8e79abe50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:10.288368 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c1ba6885-6b8c-4bb9-b0c2-c84484c63673 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:10.289568 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c1ba6885-6b8c-4bb9-b0c2-c84484c63673 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:10.297452 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1ba6885-6b8c-4bb9-b0c2-c84484c63673 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:10.297958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1ba6885-6b8c-4bb9-b0c2-c84484c63673 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:10.298662 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1ba6885-6b8c-4bb9-b0c2-c84484c63673 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:10.299407 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1ba6885-6b8c-4bb9-b0c2-c84484c63673 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:10.299898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1ba6885-6b8c-4bb9-b0c2-c84484c63673 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:10.300624 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1ba6885-6b8c-4bb9-b0c2-c84484c63673 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:10.418482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c1ba6885-6b8c-4bb9-b0c2-c84484c63673 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:10.427100 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c1ba6885-6b8c-4bb9-b0c2-c84484c63673 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1296 microversion: 2.1 time: 0.142833 Sep 19 17:25:10.428266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 133/263] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:10 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1296 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:10.452364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ebfd98d7-f8d1-430e-b8f0-2bc8e79abe50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:10.460389 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ebfd98d7-f8d1-430e-b8f0-2bc8e79abe50 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.239871 Sep 19 17:25:10.460964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 131/264] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:10 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:11.005996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:11.014331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:11.015029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:11.016140 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:11.017219 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:11.018910 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:11.019560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:11.020581 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:11.054992 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:11.055656 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:11.056073 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:11.056585 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lazy-loading 'fault' on Instance uuid 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:25:11.101479 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:11.110164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-39a2a71d-d22a-4e20-b2b5-9ce35c66d155 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 200 len: 1303 microversion: 2.1 time: 0.108281 Sep 19 17:25:11.110780 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 134/265] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:11 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:11.174136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98d20bec-b602-427c-af94-06db6eb5e929 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:11.176217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98d20bec-b602-427c-af94-06db6eb5e929 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:11.184473 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d20bec-b602-427c-af94-06db6eb5e929 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:11.185043 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d20bec-b602-427c-af94-06db6eb5e929 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:11.186527 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d20bec-b602-427c-af94-06db6eb5e929 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:11.187466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d20bec-b602-427c-af94-06db6eb5e929 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:11.188221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d20bec-b602-427c-af94-06db6eb5e929 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:11.188734 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d20bec-b602-427c-af94-06db6eb5e929 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:11.346622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-98d20bec-b602-427c-af94-06db6eb5e929 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:11.356073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98d20bec-b602-427c-af94-06db6eb5e929 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.185804 Sep 19 17:25:11.356791 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 132/266] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:11 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:11.458639 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c7423ae8-b8fa-46db-bf91-870ddfa63e90 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:11.459252 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c7423ae8-b8fa-46db-bf91-870ddfa63e90 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:11.465918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7423ae8-b8fa-46db-bf91-870ddfa63e90 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:11.466422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7423ae8-b8fa-46db-bf91-870ddfa63e90 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:11.466869 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7423ae8-b8fa-46db-bf91-870ddfa63e90 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:11.467578 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7423ae8-b8fa-46db-bf91-870ddfa63e90 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:11.468212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7423ae8-b8fa-46db-bf91-870ddfa63e90 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:11.468827 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7423ae8-b8fa-46db-bf91-870ddfa63e90 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:11.486838 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-08efdde8-28ff-4043-bb1d-5bc3eaced0f9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:11.490179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-08efdde8-28ff-4043-bb1d-5bc3eaced0f9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:11.495180 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08efdde8-28ff-4043-bb1d-5bc3eaced0f9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:11.496074 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08efdde8-28ff-4043-bb1d-5bc3eaced0f9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:11.496881 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08efdde8-28ff-4043-bb1d-5bc3eaced0f9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:11.498434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08efdde8-28ff-4043-bb1d-5bc3eaced0f9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:11.499127 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08efdde8-28ff-4043-bb1d-5bc3eaced0f9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:11.499738 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08efdde8-28ff-4043-bb1d-5bc3eaced0f9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:11.729952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c7423ae8-b8fa-46db-bf91-870ddfa63e90 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:11.745583 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c7423ae8-b8fa-46db-bf91-870ddfa63e90 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.287023 Sep 19 17:25:11.748321 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 135/267] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:11 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:11.787461 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-08efdde8-28ff-4043-bb1d-5bc3eaced0f9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:11.795133 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-08efdde8-28ff-4043-bb1d-5bc3eaced0f9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.316038 Sep 19 17:25:11.795934 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 133/268] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:11 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:12.134262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:12.134881 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:12.145452 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:12.146219 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:12.148304 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:12.148304 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:12.148533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:12.159828 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:12.180362 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] HTTP exception thrown: Instance 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 could not be found. Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Request method failure captured: Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 HTTP/1.1 Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKXNDK_zmjiwKVXTc5PH5KuDwSlaFF2aZAg_I2Q5D-Y2ZJvsvsUkSDrpHqo6jArSuS3NkmaavHaxaxzBMTw0rKOT9NVtk_I-0pOs7Q_FuEZ2trJgQvD223DtQ9Hw8LpCBsLrgB73-PXR2ehotmdplDTq9apwrwe1xCr9hQr2iJppwdI Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 521a7d164d1343aa95087e1d4b5ebb11 Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesActionsTest-553757696 Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:25:12.181990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_521a7d164d1343aa95087e1d4b5ebb11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/521a7d164d1343aa95087e1d4b5ebb11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/521a7d164d1343aa95087e1d4b5ebb11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/521a7d164d1343aa95087e1d4b5ebb11"}]}] Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-VolumesActionsTest-553757696 Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 521a7d164d1343aa95087e1d4b5ebb11 Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesActionsTest-553757696 Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-VolumesActionsTest-553757696-project Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 12b26d6cd2fc4657bb9682065168cd71 Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-VolumesActionsTest-553757696-project Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 could not be found. Sep 19 17:25:12.184051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '6311f1a9-d9cd-411a-a3f2-0133fbfca6d9'} Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 could not be found. Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:25:12.184907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 could not be found. Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 could not be found. Sep 19 17:25:12.186289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:25:12.187526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Returning 404 to user: Instance 6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:25:12.187526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-02120ad0-b6ce-40e6-8386-a7c0efbaeb45 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9" status: 404 len: 111 microversion: 2.1 time: 0.053509 Sep 19 17:25:12.187526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 136/269] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:12 2022] GET /compute/v2.1/servers/6311f1a9-d9cd-411a-a3f2-0133fbfca6d9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:25:12.309508 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1959057335", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "networks": [{"uuid": "dbea844a-2578-4e15-bc5c-36f1d79899e8"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:12.377829 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] validate_networks() for [('dbea844a-2578-4e15-bc5c-36f1d79899e8', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:25:12.379054 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-16902dde-4c04-4689-b513-924790216580 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:12.379680 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-16902dde-4c04-4689-b513-924790216580 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:12.389189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16902dde-4c04-4689-b513-924790216580 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:12.389732 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16902dde-4c04-4689-b513-924790216580 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:12.390343 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16902dde-4c04-4689-b513-924790216580 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:12.396995 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16902dde-4c04-4689-b513-924790216580 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:12.397530 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16902dde-4c04-4689-b513-924790216580 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:12.398145 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16902dde-4c04-4689-b513-924790216580 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:12.402633 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:12.605128 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-16902dde-4c04-4689-b513-924790216580 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:12.614495 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-16902dde-4c04-4689-b513-924790216580 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.239893 Sep 19 17:25:12.615120 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 137/270] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:12 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:12.774777 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9095d017-b9b1-42b6-8db6-482da5699fa6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:12.780235 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9095d017-b9b1-42b6-8db6-482da5699fa6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:12.785147 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9095d017-b9b1-42b6-8db6-482da5699fa6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:12.785857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9095d017-b9b1-42b6-8db6-482da5699fa6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:12.787242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9095d017-b9b1-42b6-8db6-482da5699fa6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:12.788039 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9095d017-b9b1-42b6-8db6-482da5699fa6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:12.789055 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9095d017-b9b1-42b6-8db6-482da5699fa6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:12.789549 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9095d017-b9b1-42b6-8db6-482da5699fa6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:12.985590 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:25:12.986685 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:25:12.986966 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:25:12.988135 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:25:12.989119 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:25:12.993083 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:13.003761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:13.004333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:13.004938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:13.016347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:13.017097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:13.017754 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:13.043954 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Getting quotas for project 521a7d164d1343aa95087e1d4b5ebb11. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:25:13.049606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Getting quotas for user 12b26d6cd2fc4657bb9682065168cd71 and project 521a7d164d1343aa95087e1d4b5ebb11. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:25:13.063419 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:25:13.066724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:25:13.071229 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9095d017-b9b1-42b6-8db6-482da5699fa6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:13.085422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9095d017-b9b1-42b6-8db6-482da5699fa6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.314117 Sep 19 17:25:13.089982 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 138/271] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:12 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:13.098565 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c2016884-902a-4bc0-b4bf-1a75f13c8701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:13.099179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c2016884-902a-4bc0-b4bf-1a75f13c8701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:13.109231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2016884-902a-4bc0-b4bf-1a75f13c8701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:13.110727 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2016884-902a-4bc0-b4bf-1a75f13c8701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:13.111033 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2016884-902a-4bc0-b4bf-1a75f13c8701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:13.113937 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2016884-902a-4bc0-b4bf-1a75f13c8701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:13.114417 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2016884-902a-4bc0-b4bf-1a75f13c8701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:13.115924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2016884-902a-4bc0-b4bf-1a75f13c8701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:13.250373 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-64522db3-ecd5-468a-8ace-bcca29e3ff3a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945210 Sep 19 17:25:13.251887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 134/272] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:25:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:25:13.262341 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0f4c14fa-43e5-497c-824d-a49095b71cb2 req-f26e180d-59a3-4935-a91e-1eceda66d8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a4c48df-be43-44ba-9cdb-0ef1fd8f1832", "tag": "bcbdade5-91b0-478b-a2b9-d91a169e51b2"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:13.279378 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0f4c14fa-43e5-497c-824d-a49095b71cb2 req-f26e180d-59a3-4935-a91e-1eceda66d8dc service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:13.280123 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0f4c14fa-43e5-497c-824d-a49095b71cb2 req-f26e180d-59a3-4935-a91e-1eceda66d8dc service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:13.280723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0f4c14fa-43e5-497c-824d-a49095b71cb2 req-f26e180d-59a3-4935-a91e-1eceda66d8dc service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:13.302630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0f4c14fa-43e5-497c-824d-a49095b71cb2 req-f26e180d-59a3-4935-a91e-1eceda66d8dc service nova] Creating event network-changed:bcbdade5-91b0-478b-a2b9-d91a169e51b2 for instance 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 on hv-cinder-84801 Sep 19 17:25:13.317646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0f4c14fa-43e5-497c-824d-a49095b71cb2 req-f26e180d-59a3-4935-a91e-1eceda66d8dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064327 Sep 19 17:25:13.318269 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 135/273] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:25:13.327110 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-827a0075-fe7a-4e58-bfd3-a865a8a335d8 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:13.327917 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-827a0075-fe7a-4e58-bfd3-a865a8a335d8 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:13.446520 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-827a0075-fe7a-4e58-bfd3-a865a8a335d8 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:13.454636 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-827a0075-fe7a-4e58-bfd3-a865a8a335d8 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1214 microversion: 2.1 time: 0.135165 Sep 19 17:25:13.458938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 136/274] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:13 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:13.470498 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c2016884-902a-4bc0-b4bf-1a75f13c8701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:13.487903 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c2016884-902a-4bc0-b4bf-1a75f13c8701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.392913 Sep 19 17:25:13.494109 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 139/275] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:13 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:13.640948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c8a86b8-b51a-4a3a-8f98-3bc25b9143a7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:13.641562 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9c8a86b8-b51a-4a3a-8f98-3bc25b9143a7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:13.654101 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c8a86b8-b51a-4a3a-8f98-3bc25b9143a7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:13.654605 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c8a86b8-b51a-4a3a-8f98-3bc25b9143a7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:13.655042 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c8a86b8-b51a-4a3a-8f98-3bc25b9143a7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:13.655805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c8a86b8-b51a-4a3a-8f98-3bc25b9143a7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:13.656261 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c8a86b8-b51a-4a3a-8f98-3bc25b9143a7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:13.656683 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c8a86b8-b51a-4a3a-8f98-3bc25b9143a7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:13.852007 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9c8a86b8-b51a-4a3a-8f98-3bc25b9143a7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:13.860455 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9c8a86b8-b51a-4a3a-8f98-3bc25b9143a7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.226986 Sep 19 17:25:13.861379 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 137/276] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:13 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:14.112976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fc7f394e-31b0-4764-a517-20075a066666 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:14.113590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fc7f394e-31b0-4764-a517-20075a066666 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:14.119790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc7f394e-31b0-4764-a517-20075a066666 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:14.120320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc7f394e-31b0-4764-a517-20075a066666 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:14.120765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc7f394e-31b0-4764-a517-20075a066666 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:14.121467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc7f394e-31b0-4764-a517-20075a066666 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:14.121949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc7f394e-31b0-4764-a517-20075a066666 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:14.122381 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc7f394e-31b0-4764-a517-20075a066666 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:14.286961 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc7f394e-31b0-4764-a517-20075a066666 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:14.295509 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fc7f394e-31b0-4764-a517-20075a066666 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.186474 Sep 19 17:25:14.311554 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 140/277] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:14 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:14.486416 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aa17da64-ddbe-4d77-8dd3-79b3f94ebf79 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:14.487249 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aa17da64-ddbe-4d77-8dd3-79b3f94ebf79 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:14.495395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa17da64-ddbe-4d77-8dd3-79b3f94ebf79 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:14.498875 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa17da64-ddbe-4d77-8dd3-79b3f94ebf79 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:14.498875 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa17da64-ddbe-4d77-8dd3-79b3f94ebf79 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:14.498875 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa17da64-ddbe-4d77-8dd3-79b3f94ebf79 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:14.498875 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa17da64-ddbe-4d77-8dd3-79b3f94ebf79 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:14.499363 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa17da64-ddbe-4d77-8dd3-79b3f94ebf79 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:14.519103 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e117896a-cf2a-445c-947e-5e6be7e0ed7b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:14.520454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e117896a-cf2a-445c-947e-5e6be7e0ed7b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:14.527527 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e117896a-cf2a-445c-947e-5e6be7e0ed7b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:14.527527 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e117896a-cf2a-445c-947e-5e6be7e0ed7b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:14.527761 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e117896a-cf2a-445c-947e-5e6be7e0ed7b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:14.528437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e117896a-cf2a-445c-947e-5e6be7e0ed7b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:14.528899 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e117896a-cf2a-445c-947e-5e6be7e0ed7b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:14.529333 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e117896a-cf2a-445c-947e-5e6be7e0ed7b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:14.565187 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-aa17da64-ddbe-4d77-8dd3-79b3f94ebf79 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:14.574935 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aa17da64-ddbe-4d77-8dd3-79b3f94ebf79 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1218 microversion: 2.1 time: 0.093466 Sep 19 17:25:14.576081 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 138/278] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:14 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:14.718877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e117896a-cf2a-445c-947e-5e6be7e0ed7b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:14.732046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e117896a-cf2a-445c-947e-5e6be7e0ed7b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.214881 Sep 19 17:25:14.732046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 141/279] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:14 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:14.882887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-178ad7ba-a452-420c-b2a9-76f9759aae06 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:14.883928 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-178ad7ba-a452-420c-b2a9-76f9759aae06 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:14.894504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178ad7ba-a452-420c-b2a9-76f9759aae06 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:14.895145 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178ad7ba-a452-420c-b2a9-76f9759aae06 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:14.895662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178ad7ba-a452-420c-b2a9-76f9759aae06 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:14.896524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178ad7ba-a452-420c-b2a9-76f9759aae06 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:14.897069 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178ad7ba-a452-420c-b2a9-76f9759aae06 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:14.897574 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178ad7ba-a452-420c-b2a9-76f9759aae06 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:15.072885 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-178ad7ba-a452-420c-b2a9-76f9759aae06 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:15.080683 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-178ad7ba-a452-420c-b2a9-76f9759aae06 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.201973 Sep 19 17:25:15.081244 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 139/280] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:14 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:15.318884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5eeddb4c-0d7d-4781-82c8-23ae572053db tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:15.319493 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5eeddb4c-0d7d-4781-82c8-23ae572053db tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:15.326656 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5eeddb4c-0d7d-4781-82c8-23ae572053db tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:15.327160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5eeddb4c-0d7d-4781-82c8-23ae572053db tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:15.327586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5eeddb4c-0d7d-4781-82c8-23ae572053db tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:15.328408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5eeddb4c-0d7d-4781-82c8-23ae572053db tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:15.329117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5eeddb4c-0d7d-4781-82c8-23ae572053db tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:15.334730 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3f5994a1-4a22-4513-adb0-00224fb7a419 req-c90c9de7-56c8-4f65-91d1-bf3e860797dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33b5624-bc7c-4818-8aa5-584440fe803b", "tag": "ed6a68bf-6926-4da7-bc07-84b7931a4dbc"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:15.340386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5eeddb4c-0d7d-4781-82c8-23ae572053db tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:15.348298 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3f5994a1-4a22-4513-adb0-00224fb7a419 req-c90c9de7-56c8-4f65-91d1-bf3e860797dc service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:15.348780 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3f5994a1-4a22-4513-adb0-00224fb7a419 req-c90c9de7-56c8-4f65-91d1-bf3e860797dc service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:15.349651 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3f5994a1-4a22-4513-adb0-00224fb7a419 req-c90c9de7-56c8-4f65-91d1-bf3e860797dc service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:15.377116 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3f5994a1-4a22-4513-adb0-00224fb7a419 req-c90c9de7-56c8-4f65-91d1-bf3e860797dc service nova] Creating event network-changed:ed6a68bf-6926-4da7-bc07-84b7931a4dbc for instance e33b5624-bc7c-4818-8aa5-584440fe803b on hv-cinder-84801 Sep 19 17:25:15.382420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3f5994a1-4a22-4513-adb0-00224fb7a419 req-c90c9de7-56c8-4f65-91d1-bf3e860797dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051546 Sep 19 17:25:15.383298 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 140/281] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:25:15.508499 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5eeddb4c-0d7d-4781-82c8-23ae572053db tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:15.516903 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5eeddb4c-0d7d-4781-82c8-23ae572053db tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.202431 Sep 19 17:25:15.518204 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 142/282] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:15 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:15.599246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-91ba3518-28f5-4df7-b536-016d7e74b6b6 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:15.600819 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-91ba3518-28f5-4df7-b536-016d7e74b6b6 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:15.607961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ba3518-28f5-4df7-b536-016d7e74b6b6 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:15.608778 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ba3518-28f5-4df7-b536-016d7e74b6b6 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:15.609432 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ba3518-28f5-4df7-b536-016d7e74b6b6 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:15.610370 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ba3518-28f5-4df7-b536-016d7e74b6b6 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:15.611037 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ba3518-28f5-4df7-b536-016d7e74b6b6 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:15.611673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ba3518-28f5-4df7-b536-016d7e74b6b6 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:15.677483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-91ba3518-28f5-4df7-b536-016d7e74b6b6 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:15.685848 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-91ba3518-28f5-4df7-b536-016d7e74b6b6 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1218 microversion: 2.1 time: 0.091414 Sep 19 17:25:15.686423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 141/283] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:15 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:15.758594 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0258ed0e-47fb-4170-9a1c-19b0d9329985 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:15.759217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0258ed0e-47fb-4170-9a1c-19b0d9329985 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:15.762800 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:15.763480 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:15.766971 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0258ed0e-47fb-4170-9a1c-19b0d9329985 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:15.767458 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0258ed0e-47fb-4170-9a1c-19b0d9329985 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:15.767928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0258ed0e-47fb-4170-9a1c-19b0d9329985 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:15.768986 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0258ed0e-47fb-4170-9a1c-19b0d9329985 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:15.769495 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0258ed0e-47fb-4170-9a1c-19b0d9329985 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:15.769930 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0258ed0e-47fb-4170-9a1c-19b0d9329985 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:15.904052 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0258ed0e-47fb-4170-9a1c-19b0d9329985 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:15.911997 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0258ed0e-47fb-4170-9a1c-19b0d9329985 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.157331 Sep 19 17:25:15.912644 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 143/284] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:15 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:16.104364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-876bfd5b-49c5-4838-9338-e5d389c5b127 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:16.104976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-876bfd5b-49c5-4838-9338-e5d389c5b127 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:16.110847 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876bfd5b-49c5-4838-9338-e5d389c5b127 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:16.111335 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876bfd5b-49c5-4838-9338-e5d389c5b127 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:16.111790 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876bfd5b-49c5-4838-9338-e5d389c5b127 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:16.112477 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876bfd5b-49c5-4838-9338-e5d389c5b127 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:16.112926 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876bfd5b-49c5-4838-9338-e5d389c5b127 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:16.113348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876bfd5b-49c5-4838-9338-e5d389c5b127 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:16.252975 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-876bfd5b-49c5-4838-9338-e5d389c5b127 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:16.257292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-876bfd5b-49c5-4838-9338-e5d389c5b127 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.157244 Sep 19 17:25:16.257861 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 142/285] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:16 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:16.542862 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-763b03e7-ae79-4b30-bf43-16d1df73f813 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:16.543676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-763b03e7-ae79-4b30-bf43-16d1df73f813 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:16.552359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-763b03e7-ae79-4b30-bf43-16d1df73f813 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:16.558212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-763b03e7-ae79-4b30-bf43-16d1df73f813 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:16.558212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-763b03e7-ae79-4b30-bf43-16d1df73f813 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:16.558212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-763b03e7-ae79-4b30-bf43-16d1df73f813 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:16.558212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-763b03e7-ae79-4b30-bf43-16d1df73f813 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:16.558657 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-763b03e7-ae79-4b30-bf43-16d1df73f813 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:16.689139 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-763b03e7-ae79-4b30-bf43-16d1df73f813 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:16.696916 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-763b03e7-ae79-4b30-bf43-16d1df73f813 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.159909 Sep 19 17:25:16.697488 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 144/286] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:16 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:16.716532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9495f26c-afb6-4fde-b870-12402ffb2a41 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:16.717244 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9495f26c-afb6-4fde-b870-12402ffb2a41 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:16.723867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9495f26c-afb6-4fde-b870-12402ffb2a41 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:16.724358 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9495f26c-afb6-4fde-b870-12402ffb2a41 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:16.724803 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9495f26c-afb6-4fde-b870-12402ffb2a41 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:16.725502 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9495f26c-afb6-4fde-b870-12402ffb2a41 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:16.725961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9495f26c-afb6-4fde-b870-12402ffb2a41 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:16.726388 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9495f26c-afb6-4fde-b870-12402ffb2a41 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:16.731224 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:16.790014 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9495f26c-afb6-4fde-b870-12402ffb2a41 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:16.798444 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9495f26c-afb6-4fde-b870-12402ffb2a41 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1218 microversion: 2.1 time: 0.086392 Sep 19 17:25:16.799019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 143/287] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:16 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:16.935502 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17e12775-4586-4902-a4bd-bb5377d8d5c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:16.936232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-17e12775-4586-4902-a4bd-bb5377d8d5c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:16.942362 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17e12775-4586-4902-a4bd-bb5377d8d5c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:16.942915 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17e12775-4586-4902-a4bd-bb5377d8d5c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:16.943469 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17e12775-4586-4902-a4bd-bb5377d8d5c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:16.944359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17e12775-4586-4902-a4bd-bb5377d8d5c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:16.944865 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17e12775-4586-4902-a4bd-bb5377d8d5c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:16.945578 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17e12775-4586-4902-a4bd-bb5377d8d5c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:17.073887 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-17e12775-4586-4902-a4bd-bb5377d8d5c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:17.081763 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-17e12775-4586-4902-a4bd-bb5377d8d5c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.150099 Sep 19 17:25:17.082337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 145/288] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:16 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:17.279374 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98d87aef-8907-4dc0-a8e5-8c77f1b8a9b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:17.280027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98d87aef-8907-4dc0-a8e5-8c77f1b8a9b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:17.286018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d87aef-8907-4dc0-a8e5-8c77f1b8a9b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:17.286517 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d87aef-8907-4dc0-a8e5-8c77f1b8a9b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:17.286960 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d87aef-8907-4dc0-a8e5-8c77f1b8a9b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:17.287655 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d87aef-8907-4dc0-a8e5-8c77f1b8a9b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:17.288157 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d87aef-8907-4dc0-a8e5-8c77f1b8a9b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:17.288574 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d87aef-8907-4dc0-a8e5-8c77f1b8a9b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:17.437276 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-98d87aef-8907-4dc0-a8e5-8c77f1b8a9b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:17.445350 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98d87aef-8907-4dc0-a8e5-8c77f1b8a9b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.170023 Sep 19 17:25:17.451791 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 144/289] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:17 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:17.725456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-44a5297f-e891-40b5-ad16-623acc397aa9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:17.726096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-44a5297f-e891-40b5-ad16-623acc397aa9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:17.734683 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a5297f-e891-40b5-ad16-623acc397aa9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:17.735176 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a5297f-e891-40b5-ad16-623acc397aa9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:17.735612 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a5297f-e891-40b5-ad16-623acc397aa9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:17.736969 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a5297f-e891-40b5-ad16-623acc397aa9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:17.737433 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a5297f-e891-40b5-ad16-623acc397aa9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:17.741550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a5297f-e891-40b5-ad16-623acc397aa9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:17.821472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76803ca5-0832-4200-ac1b-b28e9f92760c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:17.822525 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-76803ca5-0832-4200-ac1b-b28e9f92760c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:17.841156 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76803ca5-0832-4200-ac1b-b28e9f92760c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:17.841922 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76803ca5-0832-4200-ac1b-b28e9f92760c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:17.842603 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76803ca5-0832-4200-ac1b-b28e9f92760c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:17.843386 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76803ca5-0832-4200-ac1b-b28e9f92760c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:17.843945 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76803ca5-0832-4200-ac1b-b28e9f92760c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:17.844453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76803ca5-0832-4200-ac1b-b28e9f92760c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:17.885340 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-44a5297f-e891-40b5-ad16-623acc397aa9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:17.896110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-44a5297f-e891-40b5-ad16-623acc397aa9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.179995 Sep 19 17:25:17.909995 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 146/290] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:17 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:17.915904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-76803ca5-0832-4200-ac1b-b28e9f92760c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:17.924653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76803ca5-0832-4200-ac1b-b28e9f92760c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1218 microversion: 2.1 time: 0.107575 Sep 19 17:25:17.925240 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 145/291] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:17 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:18.106059 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5eda76c-ded2-462c-ae4d-64fc4bbeca97 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:18.106769 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c5eda76c-ded2-462c-ae4d-64fc4bbeca97 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:18.123454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eda76c-ded2-462c-ae4d-64fc4bbeca97 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:18.124132 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eda76c-ded2-462c-ae4d-64fc4bbeca97 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:18.124587 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eda76c-ded2-462c-ae4d-64fc4bbeca97 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:18.125307 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eda76c-ded2-462c-ae4d-64fc4bbeca97 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:18.125770 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eda76c-ded2-462c-ae4d-64fc4bbeca97 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:18.126199 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eda76c-ded2-462c-ae4d-64fc4bbeca97 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:18.419630 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c5eda76c-ded2-462c-ae4d-64fc4bbeca97 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:18.427628 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c5eda76c-ded2-462c-ae4d-64fc4bbeca97 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.326272 Sep 19 17:25:18.428362 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 147/292] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:18 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:18.468388 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-538e9c71-d128-46fd-ae52-27cbf8486de5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:18.469003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-538e9c71-d128-46fd-ae52-27cbf8486de5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:18.474866 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538e9c71-d128-46fd-ae52-27cbf8486de5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:18.475350 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538e9c71-d128-46fd-ae52-27cbf8486de5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:18.475815 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538e9c71-d128-46fd-ae52-27cbf8486de5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:18.476511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538e9c71-d128-46fd-ae52-27cbf8486de5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:18.476970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538e9c71-d128-46fd-ae52-27cbf8486de5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:18.477394 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538e9c71-d128-46fd-ae52-27cbf8486de5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:18.616403 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-538e9c71-d128-46fd-ae52-27cbf8486de5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:18.624931 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-538e9c71-d128-46fd-ae52-27cbf8486de5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.160257 Sep 19 17:25:18.625500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 146/293] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:18 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:18.922709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d0cb1eb-d2f7-4681-889c-e098872f8595 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:18.923242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7d0cb1eb-d2f7-4681-889c-e098872f8595 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:18.929285 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d0cb1eb-d2f7-4681-889c-e098872f8595 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:18.929775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d0cb1eb-d2f7-4681-889c-e098872f8595 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:18.930216 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d0cb1eb-d2f7-4681-889c-e098872f8595 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:18.930909 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d0cb1eb-d2f7-4681-889c-e098872f8595 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:18.931376 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d0cb1eb-d2f7-4681-889c-e098872f8595 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:18.931890 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d0cb1eb-d2f7-4681-889c-e098872f8595 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:18.948215 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34414a66-d77d-4e6c-8cbc-14f5f440f052 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:18.948837 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-34414a66-d77d-4e6c-8cbc-14f5f440f052 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:18.955305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34414a66-d77d-4e6c-8cbc-14f5f440f052 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:18.955831 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34414a66-d77d-4e6c-8cbc-14f5f440f052 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:18.956275 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34414a66-d77d-4e6c-8cbc-14f5f440f052 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:18.956982 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34414a66-d77d-4e6c-8cbc-14f5f440f052 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:18.957443 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34414a66-d77d-4e6c-8cbc-14f5f440f052 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:18.957871 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34414a66-d77d-4e6c-8cbc-14f5f440f052 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:19.028796 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-34414a66-d77d-4e6c-8cbc-14f5f440f052 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:19.037938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-34414a66-d77d-4e6c-8cbc-14f5f440f052 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1218 microversion: 2.1 time: 0.093612 Sep 19 17:25:19.038549 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 147/294] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:18 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:19.100535 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7d0cb1eb-d2f7-4681-889c-e098872f8595 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:19.108654 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d0cb1eb-d2f7-4681-889c-e098872f8595 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.190071 Sep 19 17:25:19.109560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 148/295] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:18 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:19.452799 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f2bd43ed-f49e-4b74-954d-33b6db85bf60 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:19.453437 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f2bd43ed-f49e-4b74-954d-33b6db85bf60 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:19.459641 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2bd43ed-f49e-4b74-954d-33b6db85bf60 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:19.460160 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2bd43ed-f49e-4b74-954d-33b6db85bf60 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:19.460604 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2bd43ed-f49e-4b74-954d-33b6db85bf60 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:19.461290 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2bd43ed-f49e-4b74-954d-33b6db85bf60 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:19.461748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2bd43ed-f49e-4b74-954d-33b6db85bf60 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:19.462173 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2bd43ed-f49e-4b74-954d-33b6db85bf60 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:19.599829 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f2bd43ed-f49e-4b74-954d-33b6db85bf60 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:19.603571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f2bd43ed-f49e-4b74-954d-33b6db85bf60 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.154565 Sep 19 17:25:19.604624 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 148/296] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:19 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:19.646776 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1cd64789-34fb-44c8-9a24-1e7088301ed8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:19.647383 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1cd64789-34fb-44c8-9a24-1e7088301ed8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:19.653387 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cd64789-34fb-44c8-9a24-1e7088301ed8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:19.653880 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cd64789-34fb-44c8-9a24-1e7088301ed8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:19.654319 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cd64789-34fb-44c8-9a24-1e7088301ed8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:19.655028 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cd64789-34fb-44c8-9a24-1e7088301ed8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:19.655486 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cd64789-34fb-44c8-9a24-1e7088301ed8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:19.655945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cd64789-34fb-44c8-9a24-1e7088301ed8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:19.831221 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1cd64789-34fb-44c8-9a24-1e7088301ed8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:19.838946 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1cd64789-34fb-44c8-9a24-1e7088301ed8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.196199 Sep 19 17:25:19.839508 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 149/297] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:19 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:20.062528 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9e76686-2548-436f-991c-7a34454830b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:20.063237 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d9e76686-2548-436f-991c-7a34454830b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:20.069217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9e76686-2548-436f-991c-7a34454830b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:20.069801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9e76686-2548-436f-991c-7a34454830b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:20.070353 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9e76686-2548-436f-991c-7a34454830b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:20.071022 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9e76686-2548-436f-991c-7a34454830b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:20.071476 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9e76686-2548-436f-991c-7a34454830b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:20.071929 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9e76686-2548-436f-991c-7a34454830b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:20.132327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fbc5a57d-50a7-430d-9384-9cde96649a9e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:20.133622 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fbc5a57d-50a7-430d-9384-9cde96649a9e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:20.136562 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9e76686-2548-436f-991c-7a34454830b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:20.139654 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc5a57d-50a7-430d-9384-9cde96649a9e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:20.140178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc5a57d-50a7-430d-9384-9cde96649a9e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:20.143864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc5a57d-50a7-430d-9384-9cde96649a9e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:20.143864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc5a57d-50a7-430d-9384-9cde96649a9e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:20.143864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc5a57d-50a7-430d-9384-9cde96649a9e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:20.143864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc5a57d-50a7-430d-9384-9cde96649a9e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:20.145963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9e76686-2548-436f-991c-7a34454830b2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1218 microversion: 2.1 time: 0.087425 Sep 19 17:25:20.158958 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 149/298] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:20 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:20.286661 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fbc5a57d-50a7-430d-9384-9cde96649a9e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:20.294840 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fbc5a57d-50a7-430d-9384-9cde96649a9e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.167031 Sep 19 17:25:20.295396 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 150/299] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:20 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:20.626637 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5fb3baa-e5fd-4829-8b79-454b24ec987d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:20.627246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c5fb3baa-e5fd-4829-8b79-454b24ec987d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:20.633740 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5fb3baa-e5fd-4829-8b79-454b24ec987d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:20.634219 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5fb3baa-e5fd-4829-8b79-454b24ec987d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:20.634655 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5fb3baa-e5fd-4829-8b79-454b24ec987d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:20.635935 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5fb3baa-e5fd-4829-8b79-454b24ec987d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:20.636391 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5fb3baa-e5fd-4829-8b79-454b24ec987d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:20.636812 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5fb3baa-e5fd-4829-8b79-454b24ec987d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:20.770583 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c5fb3baa-e5fd-4829-8b79-454b24ec987d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:20.778909 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c5fb3baa-e5fd-4829-8b79-454b24ec987d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.156129 Sep 19 17:25:20.779459 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 150/300] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:20 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:20.862412 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76adf43b-9da5-43e2-bae4-2cb20218e4b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:20.863187 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76adf43b-9da5-43e2-bae4-2cb20218e4b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:20.869206 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76adf43b-9da5-43e2-bae4-2cb20218e4b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:20.869706 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76adf43b-9da5-43e2-bae4-2cb20218e4b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:20.870126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76adf43b-9da5-43e2-bae4-2cb20218e4b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:20.870824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76adf43b-9da5-43e2-bae4-2cb20218e4b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:20.871282 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76adf43b-9da5-43e2-bae4-2cb20218e4b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:20.871735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76adf43b-9da5-43e2-bae4-2cb20218e4b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:21.048596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-76adf43b-9da5-43e2-bae4-2cb20218e4b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:21.058354 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76adf43b-9da5-43e2-bae4-2cb20218e4b4 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.199736 Sep 19 17:25:21.059064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 151/301] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:20 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:21.182500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8ca483c-fe08-404f-9470-9ae0d748eb13 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:21.183281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8ca483c-fe08-404f-9470-9ae0d748eb13 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:21.189475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ca483c-fe08-404f-9470-9ae0d748eb13 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:21.194818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ca483c-fe08-404f-9470-9ae0d748eb13 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:21.194818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ca483c-fe08-404f-9470-9ae0d748eb13 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:21.194818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ca483c-fe08-404f-9470-9ae0d748eb13 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:21.194818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ca483c-fe08-404f-9470-9ae0d748eb13 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:21.195220 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ca483c-fe08-404f-9470-9ae0d748eb13 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:21.252813 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8ca483c-fe08-404f-9470-9ae0d748eb13 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:21.261220 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8ca483c-fe08-404f-9470-9ae0d748eb13 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1218 microversion: 2.1 time: 0.083104 Sep 19 17:25:21.262184 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 151/302] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:21 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:21.316894 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fa54b6dc-6272-429f-88b0-d38e4231a687 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:21.317590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fa54b6dc-6272-429f-88b0-d38e4231a687 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:21.324443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b6dc-6272-429f-88b0-d38e4231a687 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:21.325021 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b6dc-6272-429f-88b0-d38e4231a687 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:21.325480 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b6dc-6272-429f-88b0-d38e4231a687 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:21.326135 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b6dc-6272-429f-88b0-d38e4231a687 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:21.326606 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b6dc-6272-429f-88b0-d38e4231a687 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:21.330642 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b6dc-6272-429f-88b0-d38e4231a687 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:21.458274 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa54b6dc-6272-429f-88b0-d38e4231a687 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:21.466327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fa54b6dc-6272-429f-88b0-d38e4231a687 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.153077 Sep 19 17:25:21.466327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 152/303] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:21 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:21.801359 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0562e78e-303d-4fa9-a2ac-2a81f94aeb82 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:21.801970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0562e78e-303d-4fa9-a2ac-2a81f94aeb82 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:21.808547 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0562e78e-303d-4fa9-a2ac-2a81f94aeb82 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:21.809037 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0562e78e-303d-4fa9-a2ac-2a81f94aeb82 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:21.809481 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0562e78e-303d-4fa9-a2ac-2a81f94aeb82 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:21.810181 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0562e78e-303d-4fa9-a2ac-2a81f94aeb82 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:21.810634 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0562e78e-303d-4fa9-a2ac-2a81f94aeb82 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:21.811065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0562e78e-303d-4fa9-a2ac-2a81f94aeb82 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:21.948945 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0562e78e-303d-4fa9-a2ac-2a81f94aeb82 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:21.957087 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0562e78e-303d-4fa9-a2ac-2a81f94aeb82 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.159654 Sep 19 17:25:21.957653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 152/304] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:21 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:22.081729 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0c0dd33c-f616-4d1c-b455-9e954a7ada7b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:22.082539 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0c0dd33c-f616-4d1c-b455-9e954a7ada7b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:22.085733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:22.088835 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c0dd33c-f616-4d1c-b455-9e954a7ada7b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:22.090242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c0dd33c-f616-4d1c-b455-9e954a7ada7b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:22.090531 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c0dd33c-f616-4d1c-b455-9e954a7ada7b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:22.091232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c0dd33c-f616-4d1c-b455-9e954a7ada7b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:22.091676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c0dd33c-f616-4d1c-b455-9e954a7ada7b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:22.092153 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c0dd33c-f616-4d1c-b455-9e954a7ada7b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:22.229624 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0c0dd33c-f616-4d1c-b455-9e954a7ada7b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:22.233122 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:22.237682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0c0dd33c-f616-4d1c-b455-9e954a7ada7b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.159943 Sep 19 17:25:22.238256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 153/305] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:22 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:22.285095 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0599d327-fe04-4563-b3c0-124fac4b7b1f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:22.285095 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0599d327-fe04-4563-b3c0-124fac4b7b1f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:22.290088 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0599d327-fe04-4563-b3c0-124fac4b7b1f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:22.290564 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0599d327-fe04-4563-b3c0-124fac4b7b1f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:22.290996 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0599d327-fe04-4563-b3c0-124fac4b7b1f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:22.291679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0599d327-fe04-4563-b3c0-124fac4b7b1f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:22.296927 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0599d327-fe04-4563-b3c0-124fac4b7b1f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:22.296927 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0599d327-fe04-4563-b3c0-124fac4b7b1f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:22.367110 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0599d327-fe04-4563-b3c0-124fac4b7b1f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:22.367110 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0599d327-fe04-4563-b3c0-124fac4b7b1f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1218 microversion: 2.1 time: 0.085553 Sep 19 17:25:22.367110 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 153/306] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:22 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:22.489248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88f89f54-75e4-4aa1-96e9-9584abfa5bb7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:22.490118 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-88f89f54-75e4-4aa1-96e9-9584abfa5bb7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:22.497030 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88f89f54-75e4-4aa1-96e9-9584abfa5bb7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:22.497523 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88f89f54-75e4-4aa1-96e9-9584abfa5bb7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:22.497966 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88f89f54-75e4-4aa1-96e9-9584abfa5bb7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:22.498674 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88f89f54-75e4-4aa1-96e9-9584abfa5bb7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:22.499134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88f89f54-75e4-4aa1-96e9-9584abfa5bb7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:22.499557 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88f89f54-75e4-4aa1-96e9-9584abfa5bb7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:22.643817 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-88f89f54-75e4-4aa1-96e9-9584abfa5bb7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:22.651546 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-88f89f54-75e4-4aa1-96e9-9584abfa5bb7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.166327 Sep 19 17:25:22.652178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 154/307] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:22 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:22.981149 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-67f0ad6d-dc6a-4218-b7cc-a117ea597ca2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:22.981807 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-67f0ad6d-dc6a-4218-b7cc-a117ea597ca2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:22.988399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67f0ad6d-dc6a-4218-b7cc-a117ea597ca2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:22.988887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67f0ad6d-dc6a-4218-b7cc-a117ea597ca2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:22.989330 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67f0ad6d-dc6a-4218-b7cc-a117ea597ca2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:22.990075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67f0ad6d-dc6a-4218-b7cc-a117ea597ca2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:22.990530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67f0ad6d-dc6a-4218-b7cc-a117ea597ca2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:22.990957 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67f0ad6d-dc6a-4218-b7cc-a117ea597ca2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:23.033841 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:23.125188 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-67f0ad6d-dc6a-4218-b7cc-a117ea597ca2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:23.133200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-67f0ad6d-dc6a-4218-b7cc-a117ea597ca2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.156461 Sep 19 17:25:23.133810 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 154/308] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:22 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:23.260878 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-496bdc46-80f9-412f-a0a6-020ce3f160a5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:23.261501 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-496bdc46-80f9-412f-a0a6-020ce3f160a5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:23.267733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-496bdc46-80f9-412f-a0a6-020ce3f160a5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:23.271405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-496bdc46-80f9-412f-a0a6-020ce3f160a5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:23.271405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-496bdc46-80f9-412f-a0a6-020ce3f160a5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:23.271405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-496bdc46-80f9-412f-a0a6-020ce3f160a5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:23.271405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-496bdc46-80f9-412f-a0a6-020ce3f160a5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:23.271974 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-496bdc46-80f9-412f-a0a6-020ce3f160a5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:23.395943 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03c185e2-caa0-44ff-888f-10e32fc9c545 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:23.396824 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03c185e2-caa0-44ff-888f-10e32fc9c545 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:23.403613 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03c185e2-caa0-44ff-888f-10e32fc9c545 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:23.404213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03c185e2-caa0-44ff-888f-10e32fc9c545 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:23.404664 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03c185e2-caa0-44ff-888f-10e32fc9c545 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:23.405380 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03c185e2-caa0-44ff-888f-10e32fc9c545 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:23.405867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03c185e2-caa0-44ff-888f-10e32fc9c545 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:23.406299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03c185e2-caa0-44ff-888f-10e32fc9c545 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:23.436194 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-496bdc46-80f9-412f-a0a6-020ce3f160a5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:23.444533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-496bdc46-80f9-412f-a0a6-020ce3f160a5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.187382 Sep 19 17:25:23.445706 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 155/309] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:23 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:23.454132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=24 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:23.477679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-03c185e2-caa0-44ff-888f-10e32fc9c545 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:23.486109 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03c185e2-caa0-44ff-888f-10e32fc9c545 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1218 microversion: 2.1 time: 0.094865 Sep 19 17:25:23.491121 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 155/310] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:23 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:23.674533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bec63cc8-235e-4979-b247-62aac10dd627 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:23.675148 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bec63cc8-235e-4979-b247-62aac10dd627 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:23.681120 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bec63cc8-235e-4979-b247-62aac10dd627 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:23.681615 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bec63cc8-235e-4979-b247-62aac10dd627 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:23.682113 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bec63cc8-235e-4979-b247-62aac10dd627 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:23.683473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bec63cc8-235e-4979-b247-62aac10dd627 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:23.684019 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bec63cc8-235e-4979-b247-62aac10dd627 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:23.684395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bec63cc8-235e-4979-b247-62aac10dd627 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:23.734287 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0d38d096-1d61-4f1b-85ab-460be72a767b req-10823a93-7cd8-4c19-9f3d-360a0f55c247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a4c48df-be43-44ba-9cdb-0ef1fd8f1832", "name": "network-vif-plugged", "status": "completed", "tag": "bcbdade5-91b0-478b-a2b9-d91a169e51b2"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:23.747665 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0d38d096-1d61-4f1b-85ab-460be72a767b req-10823a93-7cd8-4c19-9f3d-360a0f55c247 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:23.749083 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0d38d096-1d61-4f1b-85ab-460be72a767b req-10823a93-7cd8-4c19-9f3d-360a0f55c247 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:23.749083 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0d38d096-1d61-4f1b-85ab-460be72a767b req-10823a93-7cd8-4c19-9f3d-360a0f55c247 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:23.761617 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0d38d096-1d61-4f1b-85ab-460be72a767b req-10823a93-7cd8-4c19-9f3d-360a0f55c247 service nova] Creating event network-vif-plugged:bcbdade5-91b0-478b-a2b9-d91a169e51b2 for instance 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 on hv-cinder-84801 Sep 19 17:25:23.767160 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0d38d096-1d61-4f1b-85ab-460be72a767b req-10823a93-7cd8-4c19-9f3d-360a0f55c247 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037591 Sep 19 17:25:23.767826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 156/311] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:25:23.819157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bec63cc8-235e-4979-b247-62aac10dd627 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:23.827041 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bec63cc8-235e-4979-b247-62aac10dd627 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.156379 Sep 19 17:25:23.827590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 156/312] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:23 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:24.158285 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce0edd27-062b-4636-a1e1-70e9c6530ca1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:24.158995 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ce0edd27-062b-4636-a1e1-70e9c6530ca1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:24.165913 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce0edd27-062b-4636-a1e1-70e9c6530ca1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:24.167739 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce0edd27-062b-4636-a1e1-70e9c6530ca1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:24.167739 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce0edd27-062b-4636-a1e1-70e9c6530ca1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:24.168243 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce0edd27-062b-4636-a1e1-70e9c6530ca1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:24.168690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce0edd27-062b-4636-a1e1-70e9c6530ca1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:24.169120 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce0edd27-062b-4636-a1e1-70e9c6530ca1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:24.302870 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ce0edd27-062b-4636-a1e1-70e9c6530ca1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:24.310752 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ce0edd27-062b-4636-a1e1-70e9c6530ca1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.156805 Sep 19 17:25:24.311325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 157/313] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:24 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:24.469242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56c00418-366d-49b5-afdd-0e277a847ffa tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:24.469891 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-56c00418-366d-49b5-afdd-0e277a847ffa tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:24.475876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56c00418-366d-49b5-afdd-0e277a847ffa tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:24.476365 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56c00418-366d-49b5-afdd-0e277a847ffa tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:24.476814 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56c00418-366d-49b5-afdd-0e277a847ffa tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:24.477507 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56c00418-366d-49b5-afdd-0e277a847ffa tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:24.477967 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56c00418-366d-49b5-afdd-0e277a847ffa tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:24.478394 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56c00418-366d-49b5-afdd-0e277a847ffa tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:24.510656 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da57aacc-c110-49bc-a33c-487b36e14b7f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:24.511847 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-da57aacc-c110-49bc-a33c-487b36e14b7f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:24.525440 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da57aacc-c110-49bc-a33c-487b36e14b7f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:24.525929 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da57aacc-c110-49bc-a33c-487b36e14b7f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:24.526383 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da57aacc-c110-49bc-a33c-487b36e14b7f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:24.527788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da57aacc-c110-49bc-a33c-487b36e14b7f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:24.544012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da57aacc-c110-49bc-a33c-487b36e14b7f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:24.544464 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da57aacc-c110-49bc-a33c-487b36e14b7f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:24.651083 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-da57aacc-c110-49bc-a33c-487b36e14b7f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:24.662049 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da57aacc-c110-49bc-a33c-487b36e14b7f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1218 microversion: 2.1 time: 0.155590 Sep 19 17:25:24.666439 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 158/314] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:24 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:24.721450 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-56c00418-366d-49b5-afdd-0e277a847ffa tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:24.730956 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-56c00418-366d-49b5-afdd-0e277a847ffa tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.264974 Sep 19 17:25:24.732977 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 157/315] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:24 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:24.857322 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a750d51-948e-4129-87a2-b38add696a87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:24.857987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a750d51-948e-4129-87a2-b38add696a87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:24.868280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a750d51-948e-4129-87a2-b38add696a87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:24.868787 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a750d51-948e-4129-87a2-b38add696a87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:24.869236 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a750d51-948e-4129-87a2-b38add696a87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:24.869958 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a750d51-948e-4129-87a2-b38add696a87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:24.876930 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a750d51-948e-4129-87a2-b38add696a87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:24.880658 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a750d51-948e-4129-87a2-b38add696a87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:25.112417 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a750d51-948e-4129-87a2-b38add696a87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:25.120991 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a750d51-948e-4129-87a2-b38add696a87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.274280 Sep 19 17:25:25.121613 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 159/316] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:24 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:25.334516 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3cb501eb-c431-4847-bd9e-5133a043ac52 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:25.335144 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3cb501eb-c431-4847-bd9e-5133a043ac52 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:25.341491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cb501eb-c431-4847-bd9e-5133a043ac52 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:25.341981 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cb501eb-c431-4847-bd9e-5133a043ac52 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:25.342457 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cb501eb-c431-4847-bd9e-5133a043ac52 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:25.343164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cb501eb-c431-4847-bd9e-5133a043ac52 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:25.343630 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cb501eb-c431-4847-bd9e-5133a043ac52 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:25.344090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cb501eb-c431-4847-bd9e-5133a043ac52 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:25.481909 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3cb501eb-c431-4847-bd9e-5133a043ac52 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:25.490340 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3cb501eb-c431-4847-bd9e-5133a043ac52 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.159893 Sep 19 17:25:25.491116 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 158/317] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:25 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:25.688247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dbf2a6e6-1f7a-4efd-8273-fadd54e8c806 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:25.688976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dbf2a6e6-1f7a-4efd-8273-fadd54e8c806 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:25.695588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf2a6e6-1f7a-4efd-8273-fadd54e8c806 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:25.696112 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf2a6e6-1f7a-4efd-8273-fadd54e8c806 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:25.696556 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf2a6e6-1f7a-4efd-8273-fadd54e8c806 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:25.697282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf2a6e6-1f7a-4efd-8273-fadd54e8c806 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:25.697739 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf2a6e6-1f7a-4efd-8273-fadd54e8c806 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:25.698276 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf2a6e6-1f7a-4efd-8273-fadd54e8c806 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:25.717152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:25.757868 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a65f794-9c15-4574-893d-11c5d28e736d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:25.759824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5a65f794-9c15-4574-893d-11c5d28e736d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:25.761484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-dbf2a6e6-1f7a-4efd-8273-fadd54e8c806 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:25.771719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a65f794-9c15-4574-893d-11c5d28e736d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:25.771719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a65f794-9c15-4574-893d-11c5d28e736d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:25.771719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a65f794-9c15-4574-893d-11c5d28e736d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:25.771719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a65f794-9c15-4574-893d-11c5d28e736d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:25.772088 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a65f794-9c15-4574-893d-11c5d28e736d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:25.772088 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a65f794-9c15-4574-893d-11c5d28e736d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:25.772231 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dbf2a6e6-1f7a-4efd-8273-fadd54e8c806 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.085226 Sep 19 17:25:25.772231 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 160/318] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:25 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:26.087764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5a65f794-9c15-4574-893d-11c5d28e736d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:26.096615 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5a65f794-9c15-4574-893d-11c5d28e736d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.343416 Sep 19 17:25:26.097180 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 159/319] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:25 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:26.143622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a8ae35f-8bf9-4529-a97a-a31cd778350c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:26.144328 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0a8ae35f-8bf9-4529-a97a-a31cd778350c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:26.150659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a8ae35f-8bf9-4529-a97a-a31cd778350c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:26.151149 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a8ae35f-8bf9-4529-a97a-a31cd778350c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:26.152312 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a8ae35f-8bf9-4529-a97a-a31cd778350c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:26.153015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a8ae35f-8bf9-4529-a97a-a31cd778350c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:26.153469 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a8ae35f-8bf9-4529-a97a-a31cd778350c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:26.153902 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a8ae35f-8bf9-4529-a97a-a31cd778350c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:26.290879 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a8ae35f-8bf9-4529-a97a-a31cd778350c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:26.298786 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a8ae35f-8bf9-4529-a97a-a31cd778350c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.159393 Sep 19 17:25:26.299409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 161/320] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:26 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:26.514870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2155f1c6-cd15-43a6-b823-2032d6e30ff1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:26.515889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2155f1c6-cd15-43a6-b823-2032d6e30ff1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:26.522328 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2155f1c6-cd15-43a6-b823-2032d6e30ff1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:26.522825 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2155f1c6-cd15-43a6-b823-2032d6e30ff1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:26.527719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2155f1c6-cd15-43a6-b823-2032d6e30ff1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:26.527719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2155f1c6-cd15-43a6-b823-2032d6e30ff1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:26.527719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2155f1c6-cd15-43a6-b823-2032d6e30ff1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:26.527719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2155f1c6-cd15-43a6-b823-2032d6e30ff1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:26.660168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2155f1c6-cd15-43a6-b823-2032d6e30ff1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:26.668390 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2155f1c6-cd15-43a6-b823-2032d6e30ff1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.158097 Sep 19 17:25:26.670942 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 160/321] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:26 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:26.793696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-942b7f2a-be0e-4b4f-9ea4-6bb92d76d7dc tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:26.794311 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-942b7f2a-be0e-4b4f-9ea4-6bb92d76d7dc tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:26.801900 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-942b7f2a-be0e-4b4f-9ea4-6bb92d76d7dc tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:26.802383 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-942b7f2a-be0e-4b4f-9ea4-6bb92d76d7dc tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:26.802830 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-942b7f2a-be0e-4b4f-9ea4-6bb92d76d7dc tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:26.803662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-942b7f2a-be0e-4b4f-9ea4-6bb92d76d7dc tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:26.804240 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-942b7f2a-be0e-4b4f-9ea4-6bb92d76d7dc tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:26.805173 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-942b7f2a-be0e-4b4f-9ea4-6bb92d76d7dc tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:26.866955 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-942b7f2a-be0e-4b4f-9ea4-6bb92d76d7dc tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:26.875544 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-942b7f2a-be0e-4b4f-9ea4-6bb92d76d7dc tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.086224 Sep 19 17:25:26.876395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 162/322] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:26 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:27.119214 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ff0809a-5e50-4b96-9040-163387783669 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:27.119925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ff0809a-5e50-4b96-9040-163387783669 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:27.125905 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ff0809a-5e50-4b96-9040-163387783669 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:27.126391 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ff0809a-5e50-4b96-9040-163387783669 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:27.126824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ff0809a-5e50-4b96-9040-163387783669 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:27.127515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ff0809a-5e50-4b96-9040-163387783669 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:27.127993 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ff0809a-5e50-4b96-9040-163387783669 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:27.128415 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ff0809a-5e50-4b96-9040-163387783669 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:27.265191 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ff0809a-5e50-4b96-9040-163387783669 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:27.279322 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ff0809a-5e50-4b96-9040-163387783669 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.163459 Sep 19 17:25:27.279959 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 161/323] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:27 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:27.322094 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e10bce8-ff6f-4c5b-a66e-377ea683f983 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:27.322744 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e10bce8-ff6f-4c5b-a66e-377ea683f983 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:27.329444 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e10bce8-ff6f-4c5b-a66e-377ea683f983 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:27.329937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e10bce8-ff6f-4c5b-a66e-377ea683f983 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:27.330413 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e10bce8-ff6f-4c5b-a66e-377ea683f983 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:27.331116 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e10bce8-ff6f-4c5b-a66e-377ea683f983 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:27.331574 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e10bce8-ff6f-4c5b-a66e-377ea683f983 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:27.332028 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e10bce8-ff6f-4c5b-a66e-377ea683f983 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:27.470911 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e10bce8-ff6f-4c5b-a66e-377ea683f983 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:27.479503 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e10bce8-ff6f-4c5b-a66e-377ea683f983 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.161487 Sep 19 17:25:27.480103 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 163/324] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:27 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:27.693047 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c300aaf-8724-44e8-8724-6961f2141b7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:27.693689 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c300aaf-8724-44e8-8724-6961f2141b7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:27.700675 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c300aaf-8724-44e8-8724-6961f2141b7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:27.701177 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c300aaf-8724-44e8-8724-6961f2141b7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:27.701619 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c300aaf-8724-44e8-8724-6961f2141b7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:27.702344 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c300aaf-8724-44e8-8724-6961f2141b7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:27.702801 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c300aaf-8724-44e8-8724-6961f2141b7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:27.703238 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c300aaf-8724-44e8-8724-6961f2141b7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:27.847126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c300aaf-8724-44e8-8724-6961f2141b7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:27.855329 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c300aaf-8724-44e8-8724-6961f2141b7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.166171 Sep 19 17:25:27.856009 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 162/325] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:27 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:27.898489 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-90fcda9a-3db4-4a5f-b206-925518ba6c99 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:27.899188 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-90fcda9a-3db4-4a5f-b206-925518ba6c99 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:27.906376 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fcda9a-3db4-4a5f-b206-925518ba6c99 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:27.906862 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fcda9a-3db4-4a5f-b206-925518ba6c99 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:27.907295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fcda9a-3db4-4a5f-b206-925518ba6c99 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:27.908013 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fcda9a-3db4-4a5f-b206-925518ba6c99 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:27.908462 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fcda9a-3db4-4a5f-b206-925518ba6c99 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:27.908883 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fcda9a-3db4-4a5f-b206-925518ba6c99 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:27.971155 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-90fcda9a-3db4-4a5f-b206-925518ba6c99 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:27.979000 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-90fcda9a-3db4-4a5f-b206-925518ba6c99 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.084341 Sep 19 17:25:27.979881 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 164/326] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:27 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:28.303437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-52491791-166d-47db-ac02-1462e467f310 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:28.304094 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-52491791-166d-47db-ac02-1462e467f310 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:28.312547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52491791-166d-47db-ac02-1462e467f310 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:28.313040 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52491791-166d-47db-ac02-1462e467f310 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:28.313490 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52491791-166d-47db-ac02-1462e467f310 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:28.314195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52491791-166d-47db-ac02-1462e467f310 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:28.315451 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52491791-166d-47db-ac02-1462e467f310 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:28.315942 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52491791-166d-47db-ac02-1462e467f310 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:28.446883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-52491791-166d-47db-ac02-1462e467f310 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:28.454970 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-52491791-166d-47db-ac02-1462e467f310 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.156813 Sep 19 17:25:28.455543 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 163/327] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:28 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:28.506254 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf475865-07cf-4135-8e24-e2bbbb6f78aa tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:28.506254 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cf475865-07cf-4135-8e24-e2bbbb6f78aa tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:28.508828 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf475865-07cf-4135-8e24-e2bbbb6f78aa tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:28.509316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf475865-07cf-4135-8e24-e2bbbb6f78aa tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:28.509755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf475865-07cf-4135-8e24-e2bbbb6f78aa tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:28.510452 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf475865-07cf-4135-8e24-e2bbbb6f78aa tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:28.510941 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf475865-07cf-4135-8e24-e2bbbb6f78aa tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:28.511370 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf475865-07cf-4135-8e24-e2bbbb6f78aa tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:28.648731 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cf475865-07cf-4135-8e24-e2bbbb6f78aa tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:28.658605 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf475865-07cf-4135-8e24-e2bbbb6f78aa tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.160137 Sep 19 17:25:28.660003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 165/328] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:28 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:28.878358 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-932f67e9-29b7-4869-965f-988c0f7b675b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:28.878972 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-932f67e9-29b7-4869-965f-988c0f7b675b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:28.884798 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932f67e9-29b7-4869-965f-988c0f7b675b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:28.885285 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932f67e9-29b7-4869-965f-988c0f7b675b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:28.886228 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932f67e9-29b7-4869-965f-988c0f7b675b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:28.886926 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932f67e9-29b7-4869-965f-988c0f7b675b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:28.887383 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932f67e9-29b7-4869-965f-988c0f7b675b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:28.887869 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932f67e9-29b7-4869-965f-988c0f7b675b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:29.004452 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d781255d-219e-4d35-9dcc-0928f1464013 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:29.005230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d781255d-219e-4d35-9dcc-0928f1464013 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:29.013737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d781255d-219e-4d35-9dcc-0928f1464013 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:29.014388 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d781255d-219e-4d35-9dcc-0928f1464013 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:29.014943 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d781255d-219e-4d35-9dcc-0928f1464013 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:29.015558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d781255d-219e-4d35-9dcc-0928f1464013 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:29.016222 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d781255d-219e-4d35-9dcc-0928f1464013 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:29.016656 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d781255d-219e-4d35-9dcc-0928f1464013 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:29.021809 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-932f67e9-29b7-4869-965f-988c0f7b675b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:29.042186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-932f67e9-29b7-4869-965f-988c0f7b675b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.167604 Sep 19 17:25:29.047632 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 164/329] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:28 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:29.098357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d781255d-219e-4d35-9dcc-0928f1464013 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:29.106879 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d781255d-219e-4d35-9dcc-0928f1464013 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.108358 Sep 19 17:25:29.107657 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 166/330] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:28 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:29.477545 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c41edb9e-d976-4a54-a3d7-021b71729e71 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:29.478159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c41edb9e-d976-4a54-a3d7-021b71729e71 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:29.484770 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41edb9e-d976-4a54-a3d7-021b71729e71 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:29.484931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41edb9e-d976-4a54-a3d7-021b71729e71 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:29.485323 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41edb9e-d976-4a54-a3d7-021b71729e71 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:29.486027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41edb9e-d976-4a54-a3d7-021b71729e71 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:29.486488 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41edb9e-d976-4a54-a3d7-021b71729e71 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:29.487012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41edb9e-d976-4a54-a3d7-021b71729e71 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:29.623621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c41edb9e-d976-4a54-a3d7-021b71729e71 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:29.631603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c41edb9e-d976-4a54-a3d7-021b71729e71 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.158022 Sep 19 17:25:29.632409 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 165/331] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:29 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:29.683267 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29336225-6a06-4fdd-b8cb-e07717ecc728 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:29.683924 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-29336225-6a06-4fdd-b8cb-e07717ecc728 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:29.690015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29336225-6a06-4fdd-b8cb-e07717ecc728 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:29.690511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29336225-6a06-4fdd-b8cb-e07717ecc728 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:29.690952 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29336225-6a06-4fdd-b8cb-e07717ecc728 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:29.691650 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29336225-6a06-4fdd-b8cb-e07717ecc728 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:29.692162 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29336225-6a06-4fdd-b8cb-e07717ecc728 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:29.692591 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29336225-6a06-4fdd-b8cb-e07717ecc728 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:29.827739 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-29336225-6a06-4fdd-b8cb-e07717ecc728 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:29.841914 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29336225-6a06-4fdd-b8cb-e07717ecc728 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.163160 Sep 19 17:25:29.842603 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 167/332] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:29 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:30.071521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-49a9d3e2-e4ce-4b53-a7c3-fd5473d1879b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:30.072181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-49a9d3e2-e4ce-4b53-a7c3-fd5473d1879b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:30.079060 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a9d3e2-e4ce-4b53-a7c3-fd5473d1879b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:30.079546 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a9d3e2-e4ce-4b53-a7c3-fd5473d1879b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:30.080019 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a9d3e2-e4ce-4b53-a7c3-fd5473d1879b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:30.080716 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a9d3e2-e4ce-4b53-a7c3-fd5473d1879b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:30.081165 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a9d3e2-e4ce-4b53-a7c3-fd5473d1879b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:30.085257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a9d3e2-e4ce-4b53-a7c3-fd5473d1879b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:30.129587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ad455ce-f52c-48b6-acd1-b44efce55de2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:30.130134 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ad455ce-f52c-48b6-acd1-b44efce55de2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:30.136603 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad455ce-f52c-48b6-acd1-b44efce55de2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:30.137096 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad455ce-f52c-48b6-acd1-b44efce55de2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:30.137538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad455ce-f52c-48b6-acd1-b44efce55de2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:30.138241 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad455ce-f52c-48b6-acd1-b44efce55de2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:30.138699 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad455ce-f52c-48b6-acd1-b44efce55de2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:30.139152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad455ce-f52c-48b6-acd1-b44efce55de2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:30.211983 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ad455ce-f52c-48b6-acd1-b44efce55de2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:30.220602 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ad455ce-f52c-48b6-acd1-b44efce55de2 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.095075 Sep 19 17:25:30.224469 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 168/333] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:30 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:30.257842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-49a9d3e2-e4ce-4b53-a7c3-fd5473d1879b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:30.265358 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-49a9d3e2-e4ce-4b53-a7c3-fd5473d1879b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.197877 Sep 19 17:25:30.266192 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 166/334] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:30 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:30.654969 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e684c533-e308-4834-a1a3-ce25191dded9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:30.655492 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e684c533-e308-4834-a1a3-ce25191dded9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:30.661436 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e684c533-e308-4834-a1a3-ce25191dded9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:30.661914 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e684c533-e308-4834-a1a3-ce25191dded9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:30.662348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e684c533-e308-4834-a1a3-ce25191dded9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:30.663027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e684c533-e308-4834-a1a3-ce25191dded9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:30.663477 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e684c533-e308-4834-a1a3-ce25191dded9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:30.663926 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e684c533-e308-4834-a1a3-ce25191dded9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:30.788671 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e684c533-e308-4834-a1a3-ce25191dded9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:30.796550 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e684c533-e308-4834-a1a3-ce25191dded9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.146249 Sep 19 17:25:30.797114 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 169/335] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:30 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:30.865314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f5336c50-380b-4f22-aa49-eb1f1bda2ea9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:30.866078 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f5336c50-380b-4f22-aa49-eb1f1bda2ea9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:30.872854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5336c50-380b-4f22-aa49-eb1f1bda2ea9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:30.873338 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5336c50-380b-4f22-aa49-eb1f1bda2ea9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:30.873772 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5336c50-380b-4f22-aa49-eb1f1bda2ea9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:30.874455 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5336c50-380b-4f22-aa49-eb1f1bda2ea9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:30.874906 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5336c50-380b-4f22-aa49-eb1f1bda2ea9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:30.875326 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5336c50-380b-4f22-aa49-eb1f1bda2ea9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:31.004946 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f5336c50-380b-4f22-aa49-eb1f1bda2ea9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:31.013157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f5336c50-380b-4f22-aa49-eb1f1bda2ea9 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.151639 Sep 19 17:25:31.013727 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 167/336] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:30 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:31.244216 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9088eec5-2be0-44a4-8f24-4d55fbaa0efb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:31.244750 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9088eec5-2be0-44a4-8f24-4d55fbaa0efb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:31.251604 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9088eec5-2be0-44a4-8f24-4d55fbaa0efb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:31.252117 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9088eec5-2be0-44a4-8f24-4d55fbaa0efb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:31.252552 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9088eec5-2be0-44a4-8f24-4d55fbaa0efb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:31.253240 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9088eec5-2be0-44a4-8f24-4d55fbaa0efb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:31.253694 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9088eec5-2be0-44a4-8f24-4d55fbaa0efb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:31.254125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9088eec5-2be0-44a4-8f24-4d55fbaa0efb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:31.290156 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2f121f44-7831-433a-83b9-d0d17a5600b0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:31.290999 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2f121f44-7831-433a-83b9-d0d17a5600b0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:31.297941 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f121f44-7831-433a-83b9-d0d17a5600b0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:31.298518 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f121f44-7831-433a-83b9-d0d17a5600b0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:31.299113 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f121f44-7831-433a-83b9-d0d17a5600b0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:31.299946 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f121f44-7831-433a-83b9-d0d17a5600b0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:31.300478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f121f44-7831-433a-83b9-d0d17a5600b0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:31.301006 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f121f44-7831-433a-83b9-d0d17a5600b0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:31.316996 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9088eec5-2be0-44a4-8f24-4d55fbaa0efb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:31.324572 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9088eec5-2be0-44a4-8f24-4d55fbaa0efb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.084339 Sep 19 17:25:31.325333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 170/337] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:31 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:31.437309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2f121f44-7831-433a-83b9-d0d17a5600b0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:31.445276 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2f121f44-7831-433a-83b9-d0d17a5600b0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.159138 Sep 19 17:25:31.445969 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 168/338] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:31 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:31.831062 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3975d66-e719-4058-8457-ce04248df0cc tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:31.831062 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3975d66-e719-4058-8457-ce04248df0cc tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:31.831266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e47ffd55-61e7-4aad-8a83-43d29fe5fc70 req-9dfb5168-4fa6-4f78-bcb4-32d2bac22b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33b5624-bc7c-4818-8aa5-584440fe803b", "name": "network-vif-plugged", "status": "completed", "tag": "ed6a68bf-6926-4da7-bc07-84b7931a4dbc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:31.834809 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3975d66-e719-4058-8457-ce04248df0cc tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:31.835302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3975d66-e719-4058-8457-ce04248df0cc tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:31.836277 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3975d66-e719-4058-8457-ce04248df0cc tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:31.837363 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3975d66-e719-4058-8457-ce04248df0cc tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:31.837859 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3975d66-e719-4058-8457-ce04248df0cc tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:31.838291 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3975d66-e719-4058-8457-ce04248df0cc tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:31.841186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e47ffd55-61e7-4aad-8a83-43d29fe5fc70 req-9dfb5168-4fa6-4f78-bcb4-32d2bac22b15 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:31.841848 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e47ffd55-61e7-4aad-8a83-43d29fe5fc70 req-9dfb5168-4fa6-4f78-bcb4-32d2bac22b15 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:31.842281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e47ffd55-61e7-4aad-8a83-43d29fe5fc70 req-9dfb5168-4fa6-4f78-bcb4-32d2bac22b15 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:31.853884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e47ffd55-61e7-4aad-8a83-43d29fe5fc70 req-9dfb5168-4fa6-4f78-bcb4-32d2bac22b15 service nova] Creating event network-vif-plugged:ed6a68bf-6926-4da7-bc07-84b7931a4dbc for instance e33b5624-bc7c-4818-8aa5-584440fe803b on hv-cinder-84801 Sep 19 17:25:31.859429 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e47ffd55-61e7-4aad-8a83-43d29fe5fc70 req-9dfb5168-4fa6-4f78-bcb4-32d2bac22b15 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038411 Sep 19 17:25:31.860053 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 169/339] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:25:31.979736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c3975d66-e719-4058-8457-ce04248df0cc tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:31.987811 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3975d66-e719-4058-8457-ce04248df0cc tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.172138 Sep 19 17:25:31.999719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 171/340] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:31 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:32.043880 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fd681de5-3011-445f-8650-7d157a13a330 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:32.044594 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fd681de5-3011-445f-8650-7d157a13a330 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:32.050982 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd681de5-3011-445f-8650-7d157a13a330 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:32.051477 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd681de5-3011-445f-8650-7d157a13a330 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:32.051950 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd681de5-3011-445f-8650-7d157a13a330 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:32.052884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd681de5-3011-445f-8650-7d157a13a330 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:32.054477 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd681de5-3011-445f-8650-7d157a13a330 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:32.054918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd681de5-3011-445f-8650-7d157a13a330 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:32.196506 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fd681de5-3011-445f-8650-7d157a13a330 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:32.205832 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fd681de5-3011-445f-8650-7d157a13a330 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.166405 Sep 19 17:25:32.206782 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 170/341] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:32 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:32.348603 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3b7234c9-10c8-4f59-b292-0f0874e6e347 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:32.349347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3b7234c9-10c8-4f59-b292-0f0874e6e347 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:32.355937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b7234c9-10c8-4f59-b292-0f0874e6e347 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:32.356431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b7234c9-10c8-4f59-b292-0f0874e6e347 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:32.356934 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b7234c9-10c8-4f59-b292-0f0874e6e347 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:32.357566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b7234c9-10c8-4f59-b292-0f0874e6e347 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:32.358054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b7234c9-10c8-4f59-b292-0f0874e6e347 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:32.358609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b7234c9-10c8-4f59-b292-0f0874e6e347 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:32.427894 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3b7234c9-10c8-4f59-b292-0f0874e6e347 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:32.436149 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3b7234c9-10c8-4f59-b292-0f0874e6e347 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.091297 Sep 19 17:25:32.436714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 172/342] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:32 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:32.469350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3f0dab56-6d1f-4817-9a29-e81eb00a3b90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:32.470157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3f0dab56-6d1f-4817-9a29-e81eb00a3b90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:32.476112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f0dab56-6d1f-4817-9a29-e81eb00a3b90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:32.476805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f0dab56-6d1f-4817-9a29-e81eb00a3b90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:32.486590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f0dab56-6d1f-4817-9a29-e81eb00a3b90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:32.486590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f0dab56-6d1f-4817-9a29-e81eb00a3b90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:32.486590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f0dab56-6d1f-4817-9a29-e81eb00a3b90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:32.486590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f0dab56-6d1f-4817-9a29-e81eb00a3b90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:32.486969 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:32.627810 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f0dab56-6d1f-4817-9a29-e81eb00a3b90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:32.651131 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3f0dab56-6d1f-4817-9a29-e81eb00a3b90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.185795 Sep 19 17:25:32.655928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 171/343] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:32 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:33.010732 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ffaba77e-2268-41dc-bc07-666484a80fcb tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:33.011370 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ffaba77e-2268-41dc-bc07-666484a80fcb tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:33.018044 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffaba77e-2268-41dc-bc07-666484a80fcb tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:33.018525 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffaba77e-2268-41dc-bc07-666484a80fcb tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:33.019264 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffaba77e-2268-41dc-bc07-666484a80fcb tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:33.019983 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffaba77e-2268-41dc-bc07-666484a80fcb tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:33.020435 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffaba77e-2268-41dc-bc07-666484a80fcb tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:33.020855 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffaba77e-2268-41dc-bc07-666484a80fcb tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:33.165305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ffaba77e-2268-41dc-bc07-666484a80fcb tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:33.173512 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ffaba77e-2268-41dc-bc07-666484a80fcb tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.166682 Sep 19 17:25:33.174076 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 173/344] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:33 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:33.235271 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea4172e3-4cb3-4e82-a46f-697f3eb274d7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:33.235925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea4172e3-4cb3-4e82-a46f-697f3eb274d7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:33.242138 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea4172e3-4cb3-4e82-a46f-697f3eb274d7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:33.242629 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea4172e3-4cb3-4e82-a46f-697f3eb274d7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:33.243074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea4172e3-4cb3-4e82-a46f-697f3eb274d7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:33.243811 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea4172e3-4cb3-4e82-a46f-697f3eb274d7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:33.244320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea4172e3-4cb3-4e82-a46f-697f3eb274d7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:33.249896 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea4172e3-4cb3-4e82-a46f-697f3eb274d7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:33.374391 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea4172e3-4cb3-4e82-a46f-697f3eb274d7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:33.382027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea4172e3-4cb3-4e82-a46f-697f3eb274d7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.150921 Sep 19 17:25:33.382586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 172/345] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:33 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:33.458979 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-01c8ec6c-201c-4f37-af01-b4476117d822 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:33.459589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-01c8ec6c-201c-4f37-af01-b4476117d822 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:33.466666 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c8ec6c-201c-4f37-af01-b4476117d822 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:33.467146 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c8ec6c-201c-4f37-af01-b4476117d822 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:33.467580 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c8ec6c-201c-4f37-af01-b4476117d822 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:33.468304 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c8ec6c-201c-4f37-af01-b4476117d822 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:33.468759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c8ec6c-201c-4f37-af01-b4476117d822 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:33.469183 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c8ec6c-201c-4f37-af01-b4476117d822 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:33.529387 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-01c8ec6c-201c-4f37-af01-b4476117d822 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:33.536947 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-01c8ec6c-201c-4f37-af01-b4476117d822 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.081778 Sep 19 17:25:33.537509 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 174/346] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:33 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:33.673799 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5fb7133a-3de9-4985-a336-e89767087658 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:33.674430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5fb7133a-3de9-4985-a336-e89767087658 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:33.680683 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fb7133a-3de9-4985-a336-e89767087658 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:33.681160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fb7133a-3de9-4985-a336-e89767087658 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:33.681599 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fb7133a-3de9-4985-a336-e89767087658 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:33.682773 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fb7133a-3de9-4985-a336-e89767087658 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:33.683450 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fb7133a-3de9-4985-a336-e89767087658 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:33.684096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fb7133a-3de9-4985-a336-e89767087658 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:33.818716 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5fb7133a-3de9-4985-a336-e89767087658 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:33.827239 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5fb7133a-3de9-4985-a336-e89767087658 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.157253 Sep 19 17:25:33.827822 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 173/347] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:33 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:34.196274 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c21d7bbe-3b25-435c-ad95-4fc27c81a536 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:34.196880 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c21d7bbe-3b25-435c-ad95-4fc27c81a536 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:34.202874 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c21d7bbe-3b25-435c-ad95-4fc27c81a536 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:34.203353 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c21d7bbe-3b25-435c-ad95-4fc27c81a536 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:34.203820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c21d7bbe-3b25-435c-ad95-4fc27c81a536 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:34.204499 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c21d7bbe-3b25-435c-ad95-4fc27c81a536 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:34.204948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c21d7bbe-3b25-435c-ad95-4fc27c81a536 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:34.205366 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c21d7bbe-3b25-435c-ad95-4fc27c81a536 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:34.334900 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c21d7bbe-3b25-435c-ad95-4fc27c81a536 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:34.342917 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c21d7bbe-3b25-435c-ad95-4fc27c81a536 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.150519 Sep 19 17:25:34.343483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 175/348] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:34 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:34.405995 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9652ffc2-7626-4aa4-baf6-68d0945d5f5f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:34.406665 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9652ffc2-7626-4aa4-baf6-68d0945d5f5f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:34.412848 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9652ffc2-7626-4aa4-baf6-68d0945d5f5f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:34.413339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9652ffc2-7626-4aa4-baf6-68d0945d5f5f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:34.413785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9652ffc2-7626-4aa4-baf6-68d0945d5f5f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:34.414487 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9652ffc2-7626-4aa4-baf6-68d0945d5f5f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:34.414949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9652ffc2-7626-4aa4-baf6-68d0945d5f5f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:34.415379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9652ffc2-7626-4aa4-baf6-68d0945d5f5f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:34.551003 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9652ffc2-7626-4aa4-baf6-68d0945d5f5f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:34.558700 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-125db17b-76b3-4038-8b41-2006cbf62ec1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:34.559198 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9652ffc2-7626-4aa4-baf6-68d0945d5f5f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.156738 Sep 19 17:25:34.559299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-125db17b-76b3-4038-8b41-2006cbf62ec1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:34.559388 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 174/349] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:34 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:34.566318 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125db17b-76b3-4038-8b41-2006cbf62ec1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:34.566949 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125db17b-76b3-4038-8b41-2006cbf62ec1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:34.567396 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125db17b-76b3-4038-8b41-2006cbf62ec1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:34.568133 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125db17b-76b3-4038-8b41-2006cbf62ec1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:34.568617 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125db17b-76b3-4038-8b41-2006cbf62ec1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:34.569030 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125db17b-76b3-4038-8b41-2006cbf62ec1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:34.629593 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-125db17b-76b3-4038-8b41-2006cbf62ec1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:34.637170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-125db17b-76b3-4038-8b41-2006cbf62ec1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.082361 Sep 19 17:25:34.637746 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 176/350] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:34 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:34.850444 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25c0ee96-3e13-4fac-b382-74ff05c81de1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:34.851066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-25c0ee96-3e13-4fac-b382-74ff05c81de1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:34.862388 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c0ee96-3e13-4fac-b382-74ff05c81de1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:34.862773 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c0ee96-3e13-4fac-b382-74ff05c81de1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:34.863213 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c0ee96-3e13-4fac-b382-74ff05c81de1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:34.869032 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c0ee96-3e13-4fac-b382-74ff05c81de1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:34.869032 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c0ee96-3e13-4fac-b382-74ff05c81de1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:34.869032 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c0ee96-3e13-4fac-b382-74ff05c81de1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:34.992652 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-25c0ee96-3e13-4fac-b382-74ff05c81de1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:35.000476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25c0ee96-3e13-4fac-b382-74ff05c81de1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.153848 Sep 19 17:25:35.001051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 175/351] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:34 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:35.365949 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a035f433-c601-4e42-a96e-0da74d897c5e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:35.367007 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a035f433-c601-4e42-a96e-0da74d897c5e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:35.368448 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:35.375302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a035f433-c601-4e42-a96e-0da74d897c5e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:35.375826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a035f433-c601-4e42-a96e-0da74d897c5e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:35.376274 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a035f433-c601-4e42-a96e-0da74d897c5e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:35.377014 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a035f433-c601-4e42-a96e-0da74d897c5e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:35.377507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a035f433-c601-4e42-a96e-0da74d897c5e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:35.377933 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a035f433-c601-4e42-a96e-0da74d897c5e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:35.382227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:35.509020 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a035f433-c601-4e42-a96e-0da74d897c5e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:35.517598 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a035f433-c601-4e42-a96e-0da74d897c5e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.155444 Sep 19 17:25:35.518438 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 177/352] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:35 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:35.584311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fd54b948-f299-499c-9574-ec9ea7657372 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:35.584912 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fd54b948-f299-499c-9574-ec9ea7657372 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:35.591001 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd54b948-f299-499c-9574-ec9ea7657372 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:35.591489 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd54b948-f299-499c-9574-ec9ea7657372 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:35.591956 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd54b948-f299-499c-9574-ec9ea7657372 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:35.592652 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd54b948-f299-499c-9574-ec9ea7657372 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:35.593114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd54b948-f299-499c-9574-ec9ea7657372 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:35.593539 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd54b948-f299-499c-9574-ec9ea7657372 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:35.660741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc46154d-f483-460c-8941-51f7eab1bd59 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:35.661359 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fc46154d-f483-460c-8941-51f7eab1bd59 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:35.669458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc46154d-f483-460c-8941-51f7eab1bd59 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:35.669949 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc46154d-f483-460c-8941-51f7eab1bd59 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:35.670384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc46154d-f483-460c-8941-51f7eab1bd59 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:35.671082 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc46154d-f483-460c-8941-51f7eab1bd59 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:35.671649 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc46154d-f483-460c-8941-51f7eab1bd59 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:35.672039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc46154d-f483-460c-8941-51f7eab1bd59 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:35.747979 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc46154d-f483-460c-8941-51f7eab1bd59 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:35.752829 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fd54b948-f299-499c-9574-ec9ea7657372 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:35.756664 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc46154d-f483-460c-8941-51f7eab1bd59 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.099832 Sep 19 17:25:35.757255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 178/353] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:35 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:35.763087 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fd54b948-f299-499c-9574-ec9ea7657372 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.183661 Sep 19 17:25:35.763658 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 176/354] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:35 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:36.023959 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5149cab9-dad0-450e-869d-fd7d4ea7a46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:36.024494 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5149cab9-dad0-450e-869d-fd7d4ea7a46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:36.030363 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5149cab9-dad0-450e-869d-fd7d4ea7a46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:36.030842 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5149cab9-dad0-450e-869d-fd7d4ea7a46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:36.031286 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5149cab9-dad0-450e-869d-fd7d4ea7a46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:36.031996 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5149cab9-dad0-450e-869d-fd7d4ea7a46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:36.032458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5149cab9-dad0-450e-869d-fd7d4ea7a46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:36.032884 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5149cab9-dad0-450e-869d-fd7d4ea7a46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:36.163229 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5149cab9-dad0-450e-869d-fd7d4ea7a46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:36.170942 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5149cab9-dad0-450e-869d-fd7d4ea7a46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.150960 Sep 19 17:25:36.171584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 179/355] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:36 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:36.539776 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fc4969dc-b904-4e78-9af3-3814c991fd47 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:36.540421 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fc4969dc-b904-4e78-9af3-3814c991fd47 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:36.546884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc4969dc-b904-4e78-9af3-3814c991fd47 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:36.547370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc4969dc-b904-4e78-9af3-3814c991fd47 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:36.547842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc4969dc-b904-4e78-9af3-3814c991fd47 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:36.548540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc4969dc-b904-4e78-9af3-3814c991fd47 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:36.549006 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc4969dc-b904-4e78-9af3-3814c991fd47 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:36.549435 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc4969dc-b904-4e78-9af3-3814c991fd47 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:36.685985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc4969dc-b904-4e78-9af3-3814c991fd47 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:36.693592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fc4969dc-b904-4e78-9af3-3814c991fd47 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.157719 Sep 19 17:25:36.694150 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 177/356] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:36 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:36.780659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-633acd68-b7a9-4e81-b5cd-aa933cf2540c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:36.781325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-633acd68-b7a9-4e81-b5cd-aa933cf2540c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:36.787308 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2463a10-62d4-4978-a5ab-920981dbe857 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:36.787732 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633acd68-b7a9-4e81-b5cd-aa933cf2540c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:36.787950 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f2463a10-62d4-4978-a5ab-920981dbe857 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:36.788214 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633acd68-b7a9-4e81-b5cd-aa933cf2540c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:36.788656 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633acd68-b7a9-4e81-b5cd-aa933cf2540c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:36.789378 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633acd68-b7a9-4e81-b5cd-aa933cf2540c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:36.789835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633acd68-b7a9-4e81-b5cd-aa933cf2540c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:36.790261 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633acd68-b7a9-4e81-b5cd-aa933cf2540c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:36.794421 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2463a10-62d4-4978-a5ab-920981dbe857 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:36.794954 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2463a10-62d4-4978-a5ab-920981dbe857 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:36.795357 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2463a10-62d4-4978-a5ab-920981dbe857 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:36.796091 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2463a10-62d4-4978-a5ab-920981dbe857 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:36.796555 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2463a10-62d4-4978-a5ab-920981dbe857 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:36.796985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2463a10-62d4-4978-a5ab-920981dbe857 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:36.877452 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-633acd68-b7a9-4e81-b5cd-aa933cf2540c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:36.886894 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-633acd68-b7a9-4e81-b5cd-aa933cf2540c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.110724 Sep 19 17:25:36.887655 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 180/357] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:36 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:36.947990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2463a10-62d4-4978-a5ab-920981dbe857 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:36.955808 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2463a10-62d4-4978-a5ab-920981dbe857 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.172248 Sep 19 17:25:36.956380 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 178/358] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:36 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:37.194532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-548c305a-dc38-4705-877d-0c4ac81a3f3f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:37.195048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-548c305a-dc38-4705-877d-0c4ac81a3f3f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:37.201477 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548c305a-dc38-4705-877d-0c4ac81a3f3f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:37.201947 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548c305a-dc38-4705-877d-0c4ac81a3f3f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:37.202379 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548c305a-dc38-4705-877d-0c4ac81a3f3f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:37.203053 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548c305a-dc38-4705-877d-0c4ac81a3f3f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:37.203498 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548c305a-dc38-4705-877d-0c4ac81a3f3f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:37.203937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548c305a-dc38-4705-877d-0c4ac81a3f3f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:37.333422 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-548c305a-dc38-4705-877d-0c4ac81a3f3f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:37.341730 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-548c305a-dc38-4705-877d-0c4ac81a3f3f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.151079 Sep 19 17:25:37.342331 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 181/359] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:37 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:37.716077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-420d297e-43af-453d-8af9-9da869823847 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:37.716692 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-420d297e-43af-453d-8af9-9da869823847 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:37.722611 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-420d297e-43af-453d-8af9-9da869823847 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:37.723100 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-420d297e-43af-453d-8af9-9da869823847 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:37.723541 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-420d297e-43af-453d-8af9-9da869823847 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:37.724261 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-420d297e-43af-453d-8af9-9da869823847 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:37.724720 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-420d297e-43af-453d-8af9-9da869823847 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:37.725153 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-420d297e-43af-453d-8af9-9da869823847 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:37.858330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-420d297e-43af-453d-8af9-9da869823847 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:37.866178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-420d297e-43af-453d-8af9-9da869823847 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1318 microversion: 2.1 time: 0.153965 Sep 19 17:25:37.866749 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 179/360] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:37 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:37.910433 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c1de9f31-c849-4f56-8a58-981a2c76aa84 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:37.911134 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c1de9f31-c849-4f56-8a58-981a2c76aa84 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:37.918233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1de9f31-c849-4f56-8a58-981a2c76aa84 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:37.918727 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1de9f31-c849-4f56-8a58-981a2c76aa84 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:37.919147 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1de9f31-c849-4f56-8a58-981a2c76aa84 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:37.919901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1de9f31-c849-4f56-8a58-981a2c76aa84 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:37.920352 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1de9f31-c849-4f56-8a58-981a2c76aa84 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:37.920770 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1de9f31-c849-4f56-8a58-981a2c76aa84 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:37.982185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e857d64-3ffe-4cc7-b26b-8485ada07861 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:37.983083 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e857d64-3ffe-4cc7-b26b-8485ada07861 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:37.985584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c1de9f31-c849-4f56-8a58-981a2c76aa84 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:37.989505 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e857d64-3ffe-4cc7-b26b-8485ada07861 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:37.990073 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e857d64-3ffe-4cc7-b26b-8485ada07861 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:37.990592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e857d64-3ffe-4cc7-b26b-8485ada07861 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:37.991427 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e857d64-3ffe-4cc7-b26b-8485ada07861 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:37.991923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e857d64-3ffe-4cc7-b26b-8485ada07861 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:37.992363 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e857d64-3ffe-4cc7-b26b-8485ada07861 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:37.994026 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c1de9f31-c849-4f56-8a58-981a2c76aa84 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.087586 Sep 19 17:25:37.994624 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 182/361] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:37 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:38.128721 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2e857d64-3ffe-4cc7-b26b-8485ada07861 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:38.136434 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e857d64-3ffe-4cc7-b26b-8485ada07861 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.159011 Sep 19 17:25:38.136999 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 180/362] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:37 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:38.373915 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-576d8110-cad0-496c-8b01-56c1c58ea053 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:38.373915 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-576d8110-cad0-496c-8b01-56c1c58ea053 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:38.373915 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-576d8110-cad0-496c-8b01-56c1c58ea053 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:38.373915 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-576d8110-cad0-496c-8b01-56c1c58ea053 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:38.374746 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-576d8110-cad0-496c-8b01-56c1c58ea053 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:38.374746 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-576d8110-cad0-496c-8b01-56c1c58ea053 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:38.374746 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-576d8110-cad0-496c-8b01-56c1c58ea053 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:38.374746 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-576d8110-cad0-496c-8b01-56c1c58ea053 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:38.509912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-576d8110-cad0-496c-8b01-56c1c58ea053 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:38.518261 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-576d8110-cad0-496c-8b01-56c1c58ea053 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.156839 Sep 19 17:25:38.518795 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 183/363] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:38 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:38.889903 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2084aef-dc6f-4b4f-a75c-382a568c5a8f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:38.890515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f2084aef-dc6f-4b4f-a75c-382a568c5a8f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:38.896821 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2084aef-dc6f-4b4f-a75c-382a568c5a8f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:38.897301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2084aef-dc6f-4b4f-a75c-382a568c5a8f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:38.897736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2084aef-dc6f-4b4f-a75c-382a568c5a8f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:38.898424 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2084aef-dc6f-4b4f-a75c-382a568c5a8f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:38.898885 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2084aef-dc6f-4b4f-a75c-382a568c5a8f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:38.899310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2084aef-dc6f-4b4f-a75c-382a568c5a8f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:39.017654 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe0ee0ae-0bd4-40f8-ba16-7755e0755fa1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:39.018518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe0ee0ae-0bd4-40f8-ba16-7755e0755fa1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:39.025725 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0ee0ae-0bd4-40f8-ba16-7755e0755fa1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:39.026499 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0ee0ae-0bd4-40f8-ba16-7755e0755fa1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:39.027125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0ee0ae-0bd4-40f8-ba16-7755e0755fa1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:39.028178 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0ee0ae-0bd4-40f8-ba16-7755e0755fa1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:39.028805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0ee0ae-0bd4-40f8-ba16-7755e0755fa1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:39.029241 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0ee0ae-0bd4-40f8-ba16-7755e0755fa1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:39.046930 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2084aef-dc6f-4b4f-a75c-382a568c5a8f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:39.055305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2084aef-dc6f-4b4f-a75c-382a568c5a8f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1505 microversion: 2.1 time: 0.169655 Sep 19 17:25:39.057952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 181/364] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:38 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:39.107155 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe0ee0ae-0bd4-40f8-ba16-7755e0755fa1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:39.115316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe0ee0ae-0bd4-40f8-ba16-7755e0755fa1 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1266 microversion: 2.1 time: 0.101391 Sep 19 17:25:39.116067 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 184/365] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:39 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:39.159895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a5103047-4d8c-4721-9b5a-f72b2acdb9a3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:39.160508 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a5103047-4d8c-4721-9b5a-f72b2acdb9a3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:39.167356 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5103047-4d8c-4721-9b5a-f72b2acdb9a3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:39.167869 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5103047-4d8c-4721-9b5a-f72b2acdb9a3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:39.168387 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5103047-4d8c-4721-9b5a-f72b2acdb9a3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:39.169080 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5103047-4d8c-4721-9b5a-f72b2acdb9a3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:39.169590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5103047-4d8c-4721-9b5a-f72b2acdb9a3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:39.169960 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5103047-4d8c-4721-9b5a-f72b2acdb9a3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:39.305923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a5103047-4d8c-4721-9b5a-f72b2acdb9a3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:39.314357 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a5103047-4d8c-4721-9b5a-f72b2acdb9a3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.158215 Sep 19 17:25:39.315190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 182/366] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:39 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:39.541242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a5331d1-7b65-4692-91bf-798b2cb4021b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:39.542466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a5331d1-7b65-4692-91bf-798b2cb4021b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:39.548545 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a5331d1-7b65-4692-91bf-798b2cb4021b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:39.549032 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a5331d1-7b65-4692-91bf-798b2cb4021b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:39.549473 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a5331d1-7b65-4692-91bf-798b2cb4021b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:39.550392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a5331d1-7b65-4692-91bf-798b2cb4021b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:39.550637 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a5331d1-7b65-4692-91bf-798b2cb4021b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:39.551077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a5331d1-7b65-4692-91bf-798b2cb4021b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:39.693922 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a5331d1-7b65-4692-91bf-798b2cb4021b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:39.701696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a5331d1-7b65-4692-91bf-798b2cb4021b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1521 microversion: 2.1 time: 0.164605 Sep 19 17:25:39.702261 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 185/367] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:39 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:40.139199 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b596d01e-98df-418e-af7b-ab20a7c6ec3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:40.139955 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b596d01e-98df-418e-af7b-ab20a7c6ec3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:40.146210 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b596d01e-98df-418e-af7b-ab20a7c6ec3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:40.146698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b596d01e-98df-418e-af7b-ab20a7c6ec3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:40.147140 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b596d01e-98df-418e-af7b-ab20a7c6ec3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:40.147874 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b596d01e-98df-418e-af7b-ab20a7c6ec3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:40.148334 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b596d01e-98df-418e-af7b-ab20a7c6ec3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:40.148813 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b596d01e-98df-418e-af7b-ab20a7c6ec3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:40.210902 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b596d01e-98df-418e-af7b-ab20a7c6ec3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:40.219274 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b596d01e-98df-418e-af7b-ab20a7c6ec3c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1274 microversion: 2.1 time: 0.084528 Sep 19 17:25:40.219866 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 183/368] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:40 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:40.342361 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f402ad1f-7c33-45ec-9f81-477731c21250 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:40.343163 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f402ad1f-7c33-45ec-9f81-477731c21250 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:40.349777 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f402ad1f-7c33-45ec-9f81-477731c21250 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:40.350339 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f402ad1f-7c33-45ec-9f81-477731c21250 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:40.350781 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f402ad1f-7c33-45ec-9f81-477731c21250 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:40.351487 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f402ad1f-7c33-45ec-9f81-477731c21250 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:40.352255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f402ad1f-7c33-45ec-9f81-477731c21250 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:40.352711 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f402ad1f-7c33-45ec-9f81-477731c21250 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:40.511748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f402ad1f-7c33-45ec-9f81-477731c21250 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:40.537072 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f402ad1f-7c33-45ec-9f81-477731c21250 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.183664 Sep 19 17:25:40.537072 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 186/369] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:40 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:40.726121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-32868955-126b-4c52-ab42-13aa8abcea7d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:40.726845 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-32868955-126b-4c52-ab42-13aa8abcea7d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:40.733318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32868955-126b-4c52-ab42-13aa8abcea7d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:40.733813 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32868955-126b-4c52-ab42-13aa8abcea7d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:40.734250 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32868955-126b-4c52-ab42-13aa8abcea7d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:40.734952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32868955-126b-4c52-ab42-13aa8abcea7d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:40.735612 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32868955-126b-4c52-ab42-13aa8abcea7d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:40.736647 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32868955-126b-4c52-ab42-13aa8abcea7d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:40.886337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-32868955-126b-4c52-ab42-13aa8abcea7d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:40.897326 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-32868955-126b-4c52-ab42-13aa8abcea7d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1501 microversion: 2.1 time: 0.175165 Sep 19 17:25:40.902095 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 184/370] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:40 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:40.922649 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-69a90a68-7779-434f-87ae-f79fd20a044e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:40.923313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-69a90a68-7779-434f-87ae-f79fd20a044e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:40.930137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a90a68-7779-434f-87ae-f79fd20a044e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:40.930728 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a90a68-7779-434f-87ae-f79fd20a044e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:40.931228 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a90a68-7779-434f-87ae-f79fd20a044e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:40.932074 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a90a68-7779-434f-87ae-f79fd20a044e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:40.933226 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a90a68-7779-434f-87ae-f79fd20a044e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:40.933654 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a90a68-7779-434f-87ae-f79fd20a044e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:41.091644 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-69a90a68-7779-434f-87ae-f79fd20a044e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:41.099635 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-69a90a68-7779-434f-87ae-f79fd20a044e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1516 microversion: 2.1 time: 0.180922 Sep 19 17:25:41.100891 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 187/371] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:40 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:41.243834 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f66f1ae3-4862-4d1e-87fb-7a921f4e0b66 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:41.244466 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f66f1ae3-4862-4d1e-87fb-7a921f4e0b66 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:41.252837 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f66f1ae3-4862-4d1e-87fb-7a921f4e0b66 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:41.253581 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f66f1ae3-4862-4d1e-87fb-7a921f4e0b66 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:41.254187 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f66f1ae3-4862-4d1e-87fb-7a921f4e0b66 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:41.254915 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f66f1ae3-4862-4d1e-87fb-7a921f4e0b66 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:41.255993 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f66f1ae3-4862-4d1e-87fb-7a921f4e0b66 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:41.256453 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f66f1ae3-4862-4d1e-87fb-7a921f4e0b66 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:41.332539 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f66f1ae3-4862-4d1e-87fb-7a921f4e0b66 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:41.342582 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f66f1ae3-4862-4d1e-87fb-7a921f4e0b66 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1272 microversion: 2.1 time: 0.103834 Sep 19 17:25:41.343428 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 185/372] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:41 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:41.544561 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c1e71fb-e3c2-46ce-ac68-8d3bfb82f0e3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:41.545254 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6c1e71fb-e3c2-46ce-ac68-8d3bfb82f0e3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:41.552716 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c1e71fb-e3c2-46ce-ac68-8d3bfb82f0e3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:41.553305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c1e71fb-e3c2-46ce-ac68-8d3bfb82f0e3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:41.553885 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c1e71fb-e3c2-46ce-ac68-8d3bfb82f0e3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:41.554666 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c1e71fb-e3c2-46ce-ac68-8d3bfb82f0e3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:41.555133 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c1e71fb-e3c2-46ce-ac68-8d3bfb82f0e3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:41.555598 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c1e71fb-e3c2-46ce-ac68-8d3bfb82f0e3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:41.722206 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6c1e71fb-e3c2-46ce-ac68-8d3bfb82f0e3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:41.730994 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6c1e71fb-e3c2-46ce-ac68-8d3bfb82f0e3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.190833 Sep 19 17:25:41.731587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 188/373] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:41 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:42.367136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b0e9614-7c35-46fc-8aaa-6cfcc0baca75 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:42.367985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6b0e9614-7c35-46fc-8aaa-6cfcc0baca75 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:42.379662 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0e9614-7c35-46fc-8aaa-6cfcc0baca75 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:42.381391 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0e9614-7c35-46fc-8aaa-6cfcc0baca75 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:42.393119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0e9614-7c35-46fc-8aaa-6cfcc0baca75 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:42.393119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0e9614-7c35-46fc-8aaa-6cfcc0baca75 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:42.393119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0e9614-7c35-46fc-8aaa-6cfcc0baca75 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:42.393119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0e9614-7c35-46fc-8aaa-6cfcc0baca75 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:42.628967 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b0e9614-7c35-46fc-8aaa-6cfcc0baca75 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:42.637629 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b0e9614-7c35-46fc-8aaa-6cfcc0baca75 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.275053 Sep 19 17:25:42.638212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 186/374] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:42 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:42.760079 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af3e6d07-bc9c-4469-b90e-232ec8619d2a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:42.760911 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af3e6d07-bc9c-4469-b90e-232ec8619d2a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:42.771257 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3e6d07-bc9c-4469-b90e-232ec8619d2a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:42.773818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3e6d07-bc9c-4469-b90e-232ec8619d2a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:42.773818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3e6d07-bc9c-4469-b90e-232ec8619d2a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:42.773818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3e6d07-bc9c-4469-b90e-232ec8619d2a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:42.774114 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3e6d07-bc9c-4469-b90e-232ec8619d2a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:42.774805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3e6d07-bc9c-4469-b90e-232ec8619d2a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:42.994507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-af3e6d07-bc9c-4469-b90e-232ec8619d2a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:43.013084 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af3e6d07-bc9c-4469-b90e-232ec8619d2a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1362 microversion: 2.1 time: 0.261616 Sep 19 17:25:43.014329 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 189/375] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:42 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:43.468781 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1a68183f-8ad0-497a-8485-0f17957dfadd req-4631e789-f526-497f-b746-abeafcbf1243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3986658-9450-4b09-86ac-4d112cca8b0e", "tag": "99d1a0de-3284-4970-a396-349166d75d19"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:43.490481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1a68183f-8ad0-497a-8485-0f17957dfadd req-4631e789-f526-497f-b746-abeafcbf1243 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:43.498527 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1a68183f-8ad0-497a-8485-0f17957dfadd req-4631e789-f526-497f-b746-abeafcbf1243 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:43.498527 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1a68183f-8ad0-497a-8485-0f17957dfadd req-4631e789-f526-497f-b746-abeafcbf1243 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:43.534960 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1a68183f-8ad0-497a-8485-0f17957dfadd req-4631e789-f526-497f-b746-abeafcbf1243 service nova] Creating event network-changed:99d1a0de-3284-4970-a396-349166d75d19 for instance e3986658-9450-4b09-86ac-4d112cca8b0e on hv-cinder-84801 Sep 19 17:25:43.540185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1a68183f-8ad0-497a-8485-0f17957dfadd req-4631e789-f526-497f-b746-abeafcbf1243 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075121 Sep 19 17:25:43.541787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 187/376] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:25:43.663893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-656fb0f9-cc76-419a-a304-03b3eceaae2f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:43.666710 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-656fb0f9-cc76-419a-a304-03b3eceaae2f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:43.676987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-656fb0f9-cc76-419a-a304-03b3eceaae2f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:43.676987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-656fb0f9-cc76-419a-a304-03b3eceaae2f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:43.676987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-656fb0f9-cc76-419a-a304-03b3eceaae2f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:43.676987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-656fb0f9-cc76-419a-a304-03b3eceaae2f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:43.677316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-656fb0f9-cc76-419a-a304-03b3eceaae2f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:43.678008 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-656fb0f9-cc76-419a-a304-03b3eceaae2f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:43.847817 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-656fb0f9-cc76-419a-a304-03b3eceaae2f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:43.860081 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-656fb0f9-cc76-419a-a304-03b3eceaae2f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.202167 Sep 19 17:25:43.860903 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 190/377] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:43 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:44.039011 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2266c079-1623-47b8-a4c3-cc3075b8a618 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:44.039737 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2266c079-1623-47b8-a4c3-cc3075b8a618 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:44.046865 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2266c079-1623-47b8-a4c3-cc3075b8a618 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:44.047675 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2266c079-1623-47b8-a4c3-cc3075b8a618 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:44.048012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2266c079-1623-47b8-a4c3-cc3075b8a618 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:44.048794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2266c079-1623-47b8-a4c3-cc3075b8a618 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:44.049258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2266c079-1623-47b8-a4c3-cc3075b8a618 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:44.049683 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2266c079-1623-47b8-a4c3-cc3075b8a618 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:44.069181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:44.149302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e4243bba-5b0e-47cc-8673-cdd6896092df tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:44.157432 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e4243bba-5b0e-47cc-8673-cdd6896092df tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:44.169409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4243bba-5b0e-47cc-8673-cdd6896092df tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:44.169626 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4243bba-5b0e-47cc-8673-cdd6896092df tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:44.170019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4243bba-5b0e-47cc-8673-cdd6896092df tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:44.171849 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4243bba-5b0e-47cc-8673-cdd6896092df tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:44.171849 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4243bba-5b0e-47cc-8673-cdd6896092df tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:44.171849 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4243bba-5b0e-47cc-8673-cdd6896092df tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:44.205862 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e4243bba-5b0e-47cc-8673-cdd6896092df tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lazy-loading 'flavor' on Instance uuid 16c05ebb-0e1d-4420-b50a-c289b41715da {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:25:44.232016 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2266c079-1623-47b8-a4c3-cc3075b8a618 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:44.245408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2266c079-1623-47b8-a4c3-cc3075b8a618 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1549 microversion: 2.1 time: 0.210569 Sep 19 17:25:44.259949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 188/378] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:44 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1549 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:44.296182 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3221094-5af5-4b53-81e7-8ee65752dde6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:44.296681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e3221094-5af5-4b53-81e7-8ee65752dde6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:44.310648 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3221094-5af5-4b53-81e7-8ee65752dde6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:44.311158 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3221094-5af5-4b53-81e7-8ee65752dde6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:44.311596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3221094-5af5-4b53-81e7-8ee65752dde6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:44.312778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3221094-5af5-4b53-81e7-8ee65752dde6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:44.313256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3221094-5af5-4b53-81e7-8ee65752dde6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:44.313685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3221094-5af5-4b53-81e7-8ee65752dde6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:44.457547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e3221094-5af5-4b53-81e7-8ee65752dde6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168449 Sep 19 17:25:44.458515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 189/379] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Sep 19 17:25:44 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:25:44.513267 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:44.629802 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e4243bba-5b0e-47cc-8673-cdd6896092df tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "POST /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da/action" status: 200 len: 32 microversion: 2.1 time: 0.484217 Sep 19 17:25:44.630956 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 191/380] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:25:44 2022] POST /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da/action => generated 32 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 17:25:44.641445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc0d5dc5-1cb9-4ec8-a502-976479b9e4ba tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:44.642600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bc0d5dc5-1cb9-4ec8-a502-976479b9e4ba tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:44.649790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc0d5dc5-1cb9-4ec8-a502-976479b9e4ba tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:44.650827 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc0d5dc5-1cb9-4ec8-a502-976479b9e4ba tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:44.652818 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc0d5dc5-1cb9-4ec8-a502-976479b9e4ba tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:44.653660 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc0d5dc5-1cb9-4ec8-a502-976479b9e4ba tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:44.655479 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc0d5dc5-1cb9-4ec8-a502-976479b9e4ba tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:44.656253 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc0d5dc5-1cb9-4ec8-a502-976479b9e4ba tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:44.887031 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-70217ecb-b76a-4eda-b293-f3ac84ece583 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:44.887796 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-70217ecb-b76a-4eda-b293-f3ac84ece583 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:44.896442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70217ecb-b76a-4eda-b293-f3ac84ece583 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:44.896931 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70217ecb-b76a-4eda-b293-f3ac84ece583 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:44.897384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70217ecb-b76a-4eda-b293-f3ac84ece583 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:44.898200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70217ecb-b76a-4eda-b293-f3ac84ece583 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:44.899198 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70217ecb-b76a-4eda-b293-f3ac84ece583 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:44.899198 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70217ecb-b76a-4eda-b293-f3ac84ece583 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:45.228910 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc0d5dc5-1cb9-4ec8-a502-976479b9e4ba tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:45.238359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bc0d5dc5-1cb9-4ec8-a502-976479b9e4ba tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.600811 Sep 19 17:25:45.239460 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 190/381] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:44 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:45.473116 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-70217ecb-b76a-4eda-b293-f3ac84ece583 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:45.482577 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-70217ecb-b76a-4eda-b293-f3ac84ece583 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.601477 Sep 19 17:25:45.483597 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 192/382] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:44 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:46.176280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-da2c7f7c-4d15-49a8-8a15-237b726dbb3a req-9c1d77c2-bb6e-45c4-8d66-9e20d2d55e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33b5624-bc7c-4818-8aa5-584440fe803b", "tag": "ed6a68bf-6926-4da7-bc07-84b7931a4dbc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:46.186007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-da2c7f7c-4d15-49a8-8a15-237b726dbb3a req-9c1d77c2-bb6e-45c4-8d66-9e20d2d55e5b service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:46.186482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-da2c7f7c-4d15-49a8-8a15-237b726dbb3a req-9c1d77c2-bb6e-45c4-8d66-9e20d2d55e5b service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:46.186909 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-da2c7f7c-4d15-49a8-8a15-237b726dbb3a req-9c1d77c2-bb6e-45c4-8d66-9e20d2d55e5b service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:46.199554 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-da2c7f7c-4d15-49a8-8a15-237b726dbb3a req-9c1d77c2-bb6e-45c4-8d66-9e20d2d55e5b service nova] Creating event network-changed:ed6a68bf-6926-4da7-bc07-84b7931a4dbc for instance e33b5624-bc7c-4818-8aa5-584440fe803b on hv-cinder-84801 Sep 19 17:25:46.204796 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-da2c7f7c-4d15-49a8-8a15-237b726dbb3a req-9c1d77c2-bb6e-45c4-8d66-9e20d2d55e5b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032172 Sep 19 17:25:46.205602 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 191/383] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:25:46.269921 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-27357a91-097a-40e1-9a39-d7879b77530a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:46.270899 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-27357a91-097a-40e1-9a39-d7879b77530a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:46.283031 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27357a91-097a-40e1-9a39-d7879b77530a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:46.284333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27357a91-097a-40e1-9a39-d7879b77530a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:46.284733 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27357a91-097a-40e1-9a39-d7879b77530a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:46.285898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27357a91-097a-40e1-9a39-d7879b77530a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:46.289120 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27357a91-097a-40e1-9a39-d7879b77530a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:46.289863 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27357a91-097a-40e1-9a39-d7879b77530a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:46.494226 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-27357a91-097a-40e1-9a39-d7879b77530a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:46.508643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a71869c-25c6-4ee8-9989-3bc8d8efd02d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:46.509339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2a71869c-25c6-4ee8-9989-3bc8d8efd02d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:46.519126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a71869c-25c6-4ee8-9989-3bc8d8efd02d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:46.519340 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-27357a91-097a-40e1-9a39-d7879b77530a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.255763 Sep 19 17:25:46.520164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a71869c-25c6-4ee8-9989-3bc8d8efd02d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:46.531785 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 193/384] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:46 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:46.533216 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a71869c-25c6-4ee8-9989-3bc8d8efd02d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:46.534048 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a71869c-25c6-4ee8-9989-3bc8d8efd02d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:46.537932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a71869c-25c6-4ee8-9989-3bc8d8efd02d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:46.538449 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a71869c-25c6-4ee8-9989-3bc8d8efd02d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:46.730772 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2a71869c-25c6-4ee8-9989-3bc8d8efd02d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:46.746027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2a71869c-25c6-4ee8-9989-3bc8d8efd02d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.242540 Sep 19 17:25:46.747211 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 192/385] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:46 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:47.546116 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d08f5d19-e2a6-43fb-b878-c35301c47c90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:47.546932 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d08f5d19-e2a6-43fb-b878-c35301c47c90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:47.553547 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08f5d19-e2a6-43fb-b878-c35301c47c90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:47.554040 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08f5d19-e2a6-43fb-b878-c35301c47c90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:47.554481 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08f5d19-e2a6-43fb-b878-c35301c47c90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:47.555198 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08f5d19-e2a6-43fb-b878-c35301c47c90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:47.555682 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08f5d19-e2a6-43fb-b878-c35301c47c90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:47.556354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08f5d19-e2a6-43fb-b878-c35301c47c90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:47.736865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d08f5d19-e2a6-43fb-b878-c35301c47c90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:47.746515 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d08f5d19-e2a6-43fb-b878-c35301c47c90 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.204929 Sep 19 17:25:47.760856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 194/386] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:47 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:47.778849 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5dacd506-094e-4f69-98fe-9696e531630a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:47.788115 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5dacd506-094e-4f69-98fe-9696e531630a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:47.793573 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dacd506-094e-4f69-98fe-9696e531630a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:47.794714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dacd506-094e-4f69-98fe-9696e531630a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:47.795807 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dacd506-094e-4f69-98fe-9696e531630a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:47.797336 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dacd506-094e-4f69-98fe-9696e531630a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:47.798629 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dacd506-094e-4f69-98fe-9696e531630a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:47.806548 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dacd506-094e-4f69-98fe-9696e531630a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:47.996335 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5dacd506-094e-4f69-98fe-9696e531630a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:48.004422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5dacd506-094e-4f69-98fe-9696e531630a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.232843 Sep 19 17:25:48.007794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 193/387] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:47 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:48.770686 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a09a37d-5d57-4390-b4eb-fe77eefaa53f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:48.771227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6a09a37d-5d57-4390-b4eb-fe77eefaa53f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:48.778483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a09a37d-5d57-4390-b4eb-fe77eefaa53f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:48.778972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a09a37d-5d57-4390-b4eb-fe77eefaa53f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:48.779509 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a09a37d-5d57-4390-b4eb-fe77eefaa53f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:48.780214 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a09a37d-5d57-4390-b4eb-fe77eefaa53f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:48.780666 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a09a37d-5d57-4390-b4eb-fe77eefaa53f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:48.781089 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a09a37d-5d57-4390-b4eb-fe77eefaa53f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:48.912033 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a09a37d-5d57-4390-b4eb-fe77eefaa53f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:48.920602 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a09a37d-5d57-4390-b4eb-fe77eefaa53f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.154087 Sep 19 17:25:48.921168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 195/388] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:48 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:49.031064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-faf925d6-c91f-4c74-8378-0549f18c382b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:49.031618 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-faf925d6-c91f-4c74-8378-0549f18c382b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:49.037686 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-faf925d6-c91f-4c74-8378-0549f18c382b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:49.038174 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-faf925d6-c91f-4c74-8378-0549f18c382b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:49.038617 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-faf925d6-c91f-4c74-8378-0549f18c382b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:49.039316 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-faf925d6-c91f-4c74-8378-0549f18c382b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:49.039818 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-faf925d6-c91f-4c74-8378-0549f18c382b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:49.040248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-faf925d6-c91f-4c74-8378-0549f18c382b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:49.173919 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-faf925d6-c91f-4c74-8378-0549f18c382b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:49.181493 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-faf925d6-c91f-4c74-8378-0549f18c382b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.154433 Sep 19 17:25:49.182134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 194/389] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:49 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:49.944325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3320e038-a8e3-4e1e-835a-b66019159150 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:49.944956 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3320e038-a8e3-4e1e-835a-b66019159150 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:49.951558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3320e038-a8e3-4e1e-835a-b66019159150 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:49.952086 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3320e038-a8e3-4e1e-835a-b66019159150 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:49.952569 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3320e038-a8e3-4e1e-835a-b66019159150 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:49.953296 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3320e038-a8e3-4e1e-835a-b66019159150 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:49.953775 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3320e038-a8e3-4e1e-835a-b66019159150 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:49.954207 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3320e038-a8e3-4e1e-835a-b66019159150 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:50.086925 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3320e038-a8e3-4e1e-835a-b66019159150 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:50.096978 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3320e038-a8e3-4e1e-835a-b66019159150 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.156969 Sep 19 17:25:50.101115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 196/390] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:49 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:50.204509 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d9915a0c-a3f3-41f5-9c19-68b1b3538a1d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:50.205068 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d9915a0c-a3f3-41f5-9c19-68b1b3538a1d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:50.211076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9915a0c-a3f3-41f5-9c19-68b1b3538a1d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:50.211571 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9915a0c-a3f3-41f5-9c19-68b1b3538a1d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:50.212051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9915a0c-a3f3-41f5-9c19-68b1b3538a1d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:50.212761 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9915a0c-a3f3-41f5-9c19-68b1b3538a1d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:50.213220 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9915a0c-a3f3-41f5-9c19-68b1b3538a1d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:50.214156 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9915a0c-a3f3-41f5-9c19-68b1b3538a1d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:50.344682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9915a0c-a3f3-41f5-9c19-68b1b3538a1d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:50.352415 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d9915a0c-a3f3-41f5-9c19-68b1b3538a1d tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.151835 Sep 19 17:25:50.352980 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 195/391] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:50 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:51.122090 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-deb62783-1a3a-4c6c-b601-fec6cf068c1b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:51.122697 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-deb62783-1a3a-4c6c-b601-fec6cf068c1b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:51.129216 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-deb62783-1a3a-4c6c-b601-fec6cf068c1b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:51.129699 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-deb62783-1a3a-4c6c-b601-fec6cf068c1b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:51.130140 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-deb62783-1a3a-4c6c-b601-fec6cf068c1b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:51.130834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-deb62783-1a3a-4c6c-b601-fec6cf068c1b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:51.131295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-deb62783-1a3a-4c6c-b601-fec6cf068c1b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:51.131744 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-deb62783-1a3a-4c6c-b601-fec6cf068c1b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:51.266466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-deb62783-1a3a-4c6c-b601-fec6cf068c1b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:51.274427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-deb62783-1a3a-4c6c-b601-fec6cf068c1b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.156744 Sep 19 17:25:51.275005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 197/392] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:51 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:51.376151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9d04a03-d23a-418d-99b2-9ff4f4d322db tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:51.377277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9d04a03-d23a-418d-99b2-9ff4f4d322db tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:51.383429 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d04a03-d23a-418d-99b2-9ff4f4d322db tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:51.383946 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d04a03-d23a-418d-99b2-9ff4f4d322db tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:51.384389 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d04a03-d23a-418d-99b2-9ff4f4d322db tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:51.385080 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d04a03-d23a-418d-99b2-9ff4f4d322db tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:51.385538 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d04a03-d23a-418d-99b2-9ff4f4d322db tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:51.385967 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d04a03-d23a-418d-99b2-9ff4f4d322db tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:51.521307 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9d04a03-d23a-418d-99b2-9ff4f4d322db tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:51.529814 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9d04a03-d23a-418d-99b2-9ff4f4d322db tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.158002 Sep 19 17:25:51.530391 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 196/393] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:51 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:52.298479 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92198fc8-f682-4ffa-8517-f255592e2c45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:52.299114 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-92198fc8-f682-4ffa-8517-f255592e2c45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:52.305673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92198fc8-f682-4ffa-8517-f255592e2c45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:52.306157 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92198fc8-f682-4ffa-8517-f255592e2c45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:52.306638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92198fc8-f682-4ffa-8517-f255592e2c45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:52.307530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92198fc8-f682-4ffa-8517-f255592e2c45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:52.308090 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92198fc8-f682-4ffa-8517-f255592e2c45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:52.308473 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92198fc8-f682-4ffa-8517-f255592e2c45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:52.449279 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-92198fc8-f682-4ffa-8517-f255592e2c45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:52.456943 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-92198fc8-f682-4ffa-8517-f255592e2c45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.162291 Sep 19 17:25:52.457470 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 198/394] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:52 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:52.553238 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3152e783-08d1-45cb-ba86-36b04cd4c58f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:52.553853 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3152e783-08d1-45cb-ba86-36b04cd4c58f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:52.556131 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=88 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:25:52.561012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3152e783-08d1-45cb-ba86-36b04cd4c58f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:52.561496 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3152e783-08d1-45cb-ba86-36b04cd4c58f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:52.561961 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3152e783-08d1-45cb-ba86-36b04cd4c58f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:52.562674 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3152e783-08d1-45cb-ba86-36b04cd4c58f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:52.563128 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3152e783-08d1-45cb-ba86-36b04cd4c58f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:52.563558 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3152e783-08d1-45cb-ba86-36b04cd4c58f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:52.699004 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3152e783-08d1-45cb-ba86-36b04cd4c58f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:52.707123 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3152e783-08d1-45cb-ba86-36b04cd4c58f tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.157712 Sep 19 17:25:52.707647 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 197/395] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:52 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:53.483790 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6974fee7-ea2d-4d90-aed9-2dcc91dd2400 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:53.484779 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6974fee7-ea2d-4d90-aed9-2dcc91dd2400 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:53.497509 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6974fee7-ea2d-4d90-aed9-2dcc91dd2400 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:53.498586 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6974fee7-ea2d-4d90-aed9-2dcc91dd2400 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:53.500407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6974fee7-ea2d-4d90-aed9-2dcc91dd2400 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:53.501393 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6974fee7-ea2d-4d90-aed9-2dcc91dd2400 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:53.501880 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6974fee7-ea2d-4d90-aed9-2dcc91dd2400 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:53.502315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6974fee7-ea2d-4d90-aed9-2dcc91dd2400 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:53.720772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6974fee7-ea2d-4d90-aed9-2dcc91dd2400 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:53.732391 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-41836398-8845-47ab-8247-e8e472e61311 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:53.734140 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-41836398-8845-47ab-8247-e8e472e61311 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:53.737457 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6974fee7-ea2d-4d90-aed9-2dcc91dd2400 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.259173 Sep 19 17:25:53.738617 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 199/396] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:53 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:25:53.759934 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41836398-8845-47ab-8247-e8e472e61311 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:53.761876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41836398-8845-47ab-8247-e8e472e61311 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:53.762305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41836398-8845-47ab-8247-e8e472e61311 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:53.763811 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41836398-8845-47ab-8247-e8e472e61311 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:53.764448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41836398-8845-47ab-8247-e8e472e61311 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:53.764884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41836398-8845-47ab-8247-e8e472e61311 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:53.930929 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-41836398-8845-47ab-8247-e8e472e61311 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:53.939412 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-41836398-8845-47ab-8247-e8e472e61311 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.213249 Sep 19 17:25:53.945184 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 198/397] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:53 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:54.764264 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd12719c-d87b-404f-947b-fcca3d7a9a01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:54.764878 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd12719c-d87b-404f-947b-fcca3d7a9a01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:54.773871 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12719c-d87b-404f-947b-fcca3d7a9a01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:54.773871 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12719c-d87b-404f-947b-fcca3d7a9a01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:54.773871 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12719c-d87b-404f-947b-fcca3d7a9a01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:54.773871 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12719c-d87b-404f-947b-fcca3d7a9a01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:54.774357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12719c-d87b-404f-947b-fcca3d7a9a01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:54.774357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12719c-d87b-404f-947b-fcca3d7a9a01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:54.902937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd12719c-d87b-404f-947b-fcca3d7a9a01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:54.910644 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd12719c-d87b-404f-947b-fcca3d7a9a01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.150156 Sep 19 17:25:54.911212 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 200/398] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:54 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:54.965713 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da1ffe87-345b-41ac-bf9b-806967b23826 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:54.966327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da1ffe87-345b-41ac-bf9b-806967b23826 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:54.972402 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1ffe87-345b-41ac-bf9b-806967b23826 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:54.972892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1ffe87-345b-41ac-bf9b-806967b23826 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:54.973355 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1ffe87-345b-41ac-bf9b-806967b23826 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:54.974056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1ffe87-345b-41ac-bf9b-806967b23826 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:54.974515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1ffe87-345b-41ac-bf9b-806967b23826 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:54.974947 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1ffe87-345b-41ac-bf9b-806967b23826 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:55.104066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-da1ffe87-345b-41ac-bf9b-806967b23826 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:55.111968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da1ffe87-345b-41ac-bf9b-806967b23826 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.151676 Sep 19 17:25:55.112538 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 199/399] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:54 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:55.934935 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75e66bc4-f583-45da-9641-c2792f215959 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:55.935551 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-75e66bc4-f583-45da-9641-c2792f215959 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:55.942294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75e66bc4-f583-45da-9641-c2792f215959 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:55.942781 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75e66bc4-f583-45da-9641-c2792f215959 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:55.943230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75e66bc4-f583-45da-9641-c2792f215959 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:55.943974 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75e66bc4-f583-45da-9641-c2792f215959 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:55.944433 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75e66bc4-f583-45da-9641-c2792f215959 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:55.944863 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75e66bc4-f583-45da-9641-c2792f215959 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:56.083622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-75e66bc4-f583-45da-9641-c2792f215959 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:56.092581 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-75e66bc4-f583-45da-9641-c2792f215959 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.162177 Sep 19 17:25:56.093168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 201/400] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:55 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:56.134281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c21491af-4a4c-4013-90c5-6461fb6c0f60 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:56.134879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c21491af-4a4c-4013-90c5-6461fb6c0f60 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:56.141563 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21491af-4a4c-4013-90c5-6461fb6c0f60 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:56.144041 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21491af-4a4c-4013-90c5-6461fb6c0f60 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:56.144041 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21491af-4a4c-4013-90c5-6461fb6c0f60 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:56.144041 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21491af-4a4c-4013-90c5-6461fb6c0f60 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:56.144519 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21491af-4a4c-4013-90c5-6461fb6c0f60 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:56.144640 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21491af-4a4c-4013-90c5-6461fb6c0f60 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:56.271297 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c21491af-4a4c-4013-90c5-6461fb6c0f60 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:56.279279 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c21491af-4a4c-4013-90c5-6461fb6c0f60 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.149061 Sep 19 17:25:56.279861 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 200/401] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:56 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:57.116389 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb555a08-c0ae-468b-9672-4b32e89a8f2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:57.117004 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb555a08-c0ae-468b-9672-4b32e89a8f2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:57.123869 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb555a08-c0ae-468b-9672-4b32e89a8f2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:57.124351 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb555a08-c0ae-468b-9672-4b32e89a8f2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:57.124789 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb555a08-c0ae-468b-9672-4b32e89a8f2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:57.125483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb555a08-c0ae-468b-9672-4b32e89a8f2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:57.125937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb555a08-c0ae-468b-9672-4b32e89a8f2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:57.126362 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb555a08-c0ae-468b-9672-4b32e89a8f2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:57.254581 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb555a08-c0ae-468b-9672-4b32e89a8f2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:57.262966 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb555a08-c0ae-468b-9672-4b32e89a8f2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.150513 Sep 19 17:25:57.263547 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 202/402] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:57 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:57.302247 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-47938e7f-dee3-4476-ad89-addc7b8e0ddb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:57.302866 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-47938e7f-dee3-4476-ad89-addc7b8e0ddb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:57.309564 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47938e7f-dee3-4476-ad89-addc7b8e0ddb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:57.310052 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47938e7f-dee3-4476-ad89-addc7b8e0ddb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:57.310495 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47938e7f-dee3-4476-ad89-addc7b8e0ddb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:57.311190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47938e7f-dee3-4476-ad89-addc7b8e0ddb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:57.311651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47938e7f-dee3-4476-ad89-addc7b8e0ddb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:57.312113 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47938e7f-dee3-4476-ad89-addc7b8e0ddb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:57.444984 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-47938e7f-dee3-4476-ad89-addc7b8e0ddb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:57.451418 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-47938e7f-dee3-4476-ad89-addc7b8e0ddb tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.152973 Sep 19 17:25:57.452291 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 201/403] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:57 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:58.286286 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e46f14cb-1f9f-4ca0-9388-bcb0edf866d1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:58.286902 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e46f14cb-1f9f-4ca0-9388-bcb0edf866d1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:58.293644 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e46f14cb-1f9f-4ca0-9388-bcb0edf866d1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:58.294130 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e46f14cb-1f9f-4ca0-9388-bcb0edf866d1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:58.294571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e46f14cb-1f9f-4ca0-9388-bcb0edf866d1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:58.295269 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e46f14cb-1f9f-4ca0-9388-bcb0edf866d1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:58.295753 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e46f14cb-1f9f-4ca0-9388-bcb0edf866d1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:58.296182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e46f14cb-1f9f-4ca0-9388-bcb0edf866d1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:58.475390 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c92d09b-b00f-4fa3-9f3e-e1a42992e32c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:58.476749 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c92d09b-b00f-4fa3-9f3e-e1a42992e32c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:58.484053 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c92d09b-b00f-4fa3-9f3e-e1a42992e32c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:58.484556 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c92d09b-b00f-4fa3-9f3e-e1a42992e32c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:58.485000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c92d09b-b00f-4fa3-9f3e-e1a42992e32c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:58.488029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c92d09b-b00f-4fa3-9f3e-e1a42992e32c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:58.488503 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c92d09b-b00f-4fa3-9f3e-e1a42992e32c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:58.488940 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c92d09b-b00f-4fa3-9f3e-e1a42992e32c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:58.552847 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e46f14cb-1f9f-4ca0-9388-bcb0edf866d1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:58.563919 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e46f14cb-1f9f-4ca0-9388-bcb0edf866d1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.281166 Sep 19 17:25:58.579776 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 203/404] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:58 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:58.740521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c92d09b-b00f-4fa3-9f3e-e1a42992e32c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:58.749316 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c92d09b-b00f-4fa3-9f3e-e1a42992e32c tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.279687 Sep 19 17:25:58.750027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 202/405] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:58 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:59.591598 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14475c47-bfcf-4b2d-baa0-9953a90bd342 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:59.592631 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14475c47-bfcf-4b2d-baa0-9953a90bd342 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:59.608095 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14475c47-bfcf-4b2d-baa0-9953a90bd342 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:59.608787 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14475c47-bfcf-4b2d-baa0-9953a90bd342 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:59.609333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14475c47-bfcf-4b2d-baa0-9953a90bd342 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:59.610168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14475c47-bfcf-4b2d-baa0-9953a90bd342 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:59.612429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14475c47-bfcf-4b2d-baa0-9953a90bd342 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:59.613001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14475c47-bfcf-4b2d-baa0-9953a90bd342 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:59.753314 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-14475c47-bfcf-4b2d-baa0-9953a90bd342 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:59.761968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14475c47-bfcf-4b2d-baa0-9953a90bd342 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.175067 Sep 19 17:25:59.762556 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 204/406] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:59 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:25:59.777251 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e91b6674-5959-45ba-8eac-df47d2f608f9 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:25:59.777994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e91b6674-5959-45ba-8eac-df47d2f608f9 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:25:59.784110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91b6674-5959-45ba-8eac-df47d2f608f9 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:59.784595 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91b6674-5959-45ba-8eac-df47d2f608f9 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:59.785039 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91b6674-5959-45ba-8eac-df47d2f608f9 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:59.785735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91b6674-5959-45ba-8eac-df47d2f608f9 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:59.786192 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91b6674-5959-45ba-8eac-df47d2f608f9 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:59.786618 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91b6674-5959-45ba-8eac-df47d2f608f9 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:59.809119 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3f2a09e2-c916-4c82-ac88-d3eec733597d req-ed2f8cd2-4079-4a35-839e-f7048953a367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3986658-9450-4b09-86ac-4d112cca8b0e", "name": "network-vif-plugged", "status": "completed", "tag": "99d1a0de-3284-4970-a396-349166d75d19"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:25:59.818517 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3f2a09e2-c916-4c82-ac88-d3eec733597d req-ed2f8cd2-4079-4a35-839e-f7048953a367 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:25:59.819001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3f2a09e2-c916-4c82-ac88-d3eec733597d req-ed2f8cd2-4079-4a35-839e-f7048953a367 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:25:59.819433 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3f2a09e2-c916-4c82-ac88-d3eec733597d req-ed2f8cd2-4079-4a35-839e-f7048953a367 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:25:59.834348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3f2a09e2-c916-4c82-ac88-d3eec733597d req-ed2f8cd2-4079-4a35-839e-f7048953a367 service nova] Creating event network-vif-plugged:99d1a0de-3284-4970-a396-349166d75d19 for instance e3986658-9450-4b09-86ac-4d112cca8b0e on hv-cinder-84801 Sep 19 17:25:59.840265 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3f2a09e2-c916-4c82-ac88-d3eec733597d req-ed2f8cd2-4079-4a35-839e-f7048953a367 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035086 Sep 19 17:25:59.840869 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 205/407] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:25:59.920943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e91b6674-5959-45ba-8eac-df47d2f608f9 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:25:59.928516 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e91b6674-5959-45ba-8eac-df47d2f608f9 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.156006 Sep 19 17:25:59.929090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 203/408] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:25:59 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:00.786897 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ada658fc-bf23-43ab-b0fa-9133d42cfbbe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:00.787527 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ada658fc-bf23-43ab-b0fa-9133d42cfbbe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:00.794199 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ada658fc-bf23-43ab-b0fa-9133d42cfbbe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:00.794682 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ada658fc-bf23-43ab-b0fa-9133d42cfbbe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:00.795121 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ada658fc-bf23-43ab-b0fa-9133d42cfbbe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:00.795838 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ada658fc-bf23-43ab-b0fa-9133d42cfbbe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:00.796297 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ada658fc-bf23-43ab-b0fa-9133d42cfbbe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:00.796726 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ada658fc-bf23-43ab-b0fa-9133d42cfbbe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:00.925845 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ada658fc-bf23-43ab-b0fa-9133d42cfbbe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:00.933484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ada658fc-bf23-43ab-b0fa-9133d42cfbbe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.151337 Sep 19 17:26:00.934087 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 206/409] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:00 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:00.951358 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3c2657e-0bcb-445a-8aa9-fce0065d0e7b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:00.952009 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3c2657e-0bcb-445a-8aa9-fce0065d0e7b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:00.957875 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3c2657e-0bcb-445a-8aa9-fce0065d0e7b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:00.958362 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3c2657e-0bcb-445a-8aa9-fce0065d0e7b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:00.958857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3c2657e-0bcb-445a-8aa9-fce0065d0e7b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:00.959552 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3c2657e-0bcb-445a-8aa9-fce0065d0e7b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:00.960045 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3c2657e-0bcb-445a-8aa9-fce0065d0e7b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:00.964328 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3c2657e-0bcb-445a-8aa9-fce0065d0e7b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:01.095513 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3c2657e-0bcb-445a-8aa9-fce0065d0e7b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:01.103209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a3c2657e-0bcb-445a-8aa9-fce0065d0e7b tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.155711 Sep 19 17:26:01.104315 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 204/410] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:00 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:01.956592 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b072913c-ad43-41de-8aec-074c14c37f35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:01.957206 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b072913c-ad43-41de-8aec-074c14c37f35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:01.964061 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b072913c-ad43-41de-8aec-074c14c37f35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:01.964551 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b072913c-ad43-41de-8aec-074c14c37f35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:01.965389 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b072913c-ad43-41de-8aec-074c14c37f35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:01.966103 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b072913c-ad43-41de-8aec-074c14c37f35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:01.966570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b072913c-ad43-41de-8aec-074c14c37f35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:01.967000 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b072913c-ad43-41de-8aec-074c14c37f35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:02.106905 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b072913c-ad43-41de-8aec-074c14c37f35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:02.114915 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b072913c-ad43-41de-8aec-074c14c37f35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.162133 Sep 19 17:26:02.116329 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 207/411] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:01 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:02.127458 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5fa7cbec-6f39-4300-ad74-079e88a660d5 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:02.128998 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5fa7cbec-6f39-4300-ad74-079e88a660d5 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:02.144497 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fa7cbec-6f39-4300-ad74-079e88a660d5 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:02.144497 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fa7cbec-6f39-4300-ad74-079e88a660d5 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:02.144497 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fa7cbec-6f39-4300-ad74-079e88a660d5 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:02.144497 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fa7cbec-6f39-4300-ad74-079e88a660d5 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:02.144845 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fa7cbec-6f39-4300-ad74-079e88a660d5 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:02.144845 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fa7cbec-6f39-4300-ad74-079e88a660d5 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:02.292780 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5fa7cbec-6f39-4300-ad74-079e88a660d5 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:02.301445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5fa7cbec-6f39-4300-ad74-079e88a660d5 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1314 microversion: 2.1 time: 0.178638 Sep 19 17:26:02.303633 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 205/412] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:02 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:03.142424 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7afccdc4-818d-4704-b37e-cc1a629ecb01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:03.143580 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7afccdc4-818d-4704-b37e-cc1a629ecb01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:03.149932 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7afccdc4-818d-4704-b37e-cc1a629ecb01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:03.157330 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7afccdc4-818d-4704-b37e-cc1a629ecb01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:03.163583 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7afccdc4-818d-4704-b37e-cc1a629ecb01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:03.163583 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7afccdc4-818d-4704-b37e-cc1a629ecb01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:03.163583 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7afccdc4-818d-4704-b37e-cc1a629ecb01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:03.163583 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7afccdc4-818d-4704-b37e-cc1a629ecb01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:03.316901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7afccdc4-818d-4704-b37e-cc1a629ecb01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:03.329388 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f24b2240-a997-4c6d-8229-89bb021486d7 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:03.330004 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f24b2240-a997-4c6d-8229-89bb021486d7 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:03.342309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f24b2240-a997-4c6d-8229-89bb021486d7 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:03.344098 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f24b2240-a997-4c6d-8229-89bb021486d7 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:03.346511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7afccdc4-818d-4704-b37e-cc1a629ecb01 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.206503 Sep 19 17:26:03.346511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 208/413] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:03 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:03.346860 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f24b2240-a997-4c6d-8229-89bb021486d7 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:03.346948 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f24b2240-a997-4c6d-8229-89bb021486d7 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:03.347531 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f24b2240-a997-4c6d-8229-89bb021486d7 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:03.348251 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f24b2240-a997-4c6d-8229-89bb021486d7 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:03.376387 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:03.499602 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f24b2240-a997-4c6d-8229-89bb021486d7 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:03.507443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f24b2240-a997-4c6d-8229-89bb021486d7 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1498 microversion: 2.1 time: 0.182747 Sep 19 17:26:03.508044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 206/414] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:03 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1498 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:26:04.380476 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d2a9b8b3-ea9a-4486-a358-8e4a661ed913 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:04.380476 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d2a9b8b3-ea9a-4486-a358-8e4a661ed913 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:04.380476 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2a9b8b3-ea9a-4486-a358-8e4a661ed913 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:04.381137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2a9b8b3-ea9a-4486-a358-8e4a661ed913 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:04.383724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2a9b8b3-ea9a-4486-a358-8e4a661ed913 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:04.383724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2a9b8b3-ea9a-4486-a358-8e4a661ed913 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:04.383724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2a9b8b3-ea9a-4486-a358-8e4a661ed913 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:04.384013 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2a9b8b3-ea9a-4486-a358-8e4a661ed913 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:04.394300 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:04.545445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d2a9b8b3-ea9a-4486-a358-8e4a661ed913 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:04.551896 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d2a9b8b3-ea9a-4486-a358-8e4a661ed913 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.186961 Sep 19 17:26:04.552465 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 209/415] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:04 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:05.116670 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a34123e4-03c1-457f-8f50-1748c27a0990 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:05.117180 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a34123e4-03c1-457f-8f50-1748c27a0990 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:05.123085 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a34123e4-03c1-457f-8f50-1748c27a0990 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:05.123558 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a34123e4-03c1-457f-8f50-1748c27a0990 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:05.124019 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a34123e4-03c1-457f-8f50-1748c27a0990 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:05.124703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a34123e4-03c1-457f-8f50-1748c27a0990 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:05.125216 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a34123e4-03c1-457f-8f50-1748c27a0990 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:05.125637 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a34123e4-03c1-457f-8f50-1748c27a0990 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:05.151321 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a34123e4-03c1-457f-8f50-1748c27a0990 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:26:05.433404 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a34123e4-03c1-457f-8f50-1748c27a0990 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 204 len: 0 microversion: 2.1 time: 0.320185 Sep 19 17:26:05.434036 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 207/416] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:26:05 2022] DELETE /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:26:05.442564 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cbdfc366-9bf6-4bd8-957a-70a7a7f7e09a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:05.443176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cbdfc366-9bf6-4bd8-957a-70a7a7f7e09a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:05.450480 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbdfc366-9bf6-4bd8-957a-70a7a7f7e09a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:05.450962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbdfc366-9bf6-4bd8-957a-70a7a7f7e09a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:05.451398 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbdfc366-9bf6-4bd8-957a-70a7a7f7e09a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:05.452124 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbdfc366-9bf6-4bd8-957a-70a7a7f7e09a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:05.452588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbdfc366-9bf6-4bd8-957a-70a7a7f7e09a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:05.453004 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbdfc366-9bf6-4bd8-957a-70a7a7f7e09a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:05.575178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c73b7e8-4a53-48d7-a4b0-1d07aa937bd6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:05.575928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c73b7e8-4a53-48d7-a4b0-1d07aa937bd6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:05.581949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c73b7e8-4a53-48d7-a4b0-1d07aa937bd6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:05.582456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c73b7e8-4a53-48d7-a4b0-1d07aa937bd6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:05.582899 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c73b7e8-4a53-48d7-a4b0-1d07aa937bd6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:05.583299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cbdfc366-9bf6-4bd8-957a-70a7a7f7e09a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:05.583603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c73b7e8-4a53-48d7-a4b0-1d07aa937bd6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:05.584157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c73b7e8-4a53-48d7-a4b0-1d07aa937bd6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:05.584720 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c73b7e8-4a53-48d7-a4b0-1d07aa937bd6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:05.591348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cbdfc366-9bf6-4bd8-957a-70a7a7f7e09a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1504 microversion: 2.1 time: 0.152870 Sep 19 17:26:05.592178 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 210/417] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:05 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:05.941924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c73b7e8-4a53-48d7-a4b0-1d07aa937bd6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:05.952427 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c73b7e8-4a53-48d7-a4b0-1d07aa937bd6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.381567 Sep 19 17:26:05.964391 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 208/418] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:05 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:26:06.619960 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a6159b0-ddec-46d3-9416-d3071bd5b53a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:06.621168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9a6159b0-ddec-46d3-9416-d3071bd5b53a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:06.623898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=68 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:06.632262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a6159b0-ddec-46d3-9416-d3071bd5b53a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:06.632262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a6159b0-ddec-46d3-9416-d3071bd5b53a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:06.632262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a6159b0-ddec-46d3-9416-d3071bd5b53a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:06.632262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a6159b0-ddec-46d3-9416-d3071bd5b53a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:06.632619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a6159b0-ddec-46d3-9416-d3071bd5b53a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:06.632619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a6159b0-ddec-46d3-9416-d3071bd5b53a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:06.799036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9a6159b0-ddec-46d3-9416-d3071bd5b53a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:06.807672 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9a6159b0-ddec-46d3-9416-d3071bd5b53a tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1504 microversion: 2.1 time: 0.191663 Sep 19 17:26:06.808417 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 211/419] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:06 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:26:06.976476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6e53309-4281-4b19-95f0-7ee154c21e70 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:06.977112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d6e53309-4281-4b19-95f0-7ee154c21e70 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:06.987326 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e53309-4281-4b19-95f0-7ee154c21e70 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:06.988032 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e53309-4281-4b19-95f0-7ee154c21e70 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:06.988552 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e53309-4281-4b19-95f0-7ee154c21e70 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:06.989271 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e53309-4281-4b19-95f0-7ee154c21e70 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:06.989737 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e53309-4281-4b19-95f0-7ee154c21e70 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:06.990183 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e53309-4281-4b19-95f0-7ee154c21e70 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:07.131339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d6e53309-4281-4b19-95f0-7ee154c21e70 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:07.140485 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6e53309-4281-4b19-95f0-7ee154c21e70 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.168213 Sep 19 17:26:07.142494 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 209/420] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:06 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:07.830794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5adfe3ca-e5c0-4456-8614-5420a6883559 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:07.831400 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5adfe3ca-e5c0-4456-8614-5420a6883559 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:07.838019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adfe3ca-e5c0-4456-8614-5420a6883559 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:07.838497 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adfe3ca-e5c0-4456-8614-5420a6883559 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:07.838925 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adfe3ca-e5c0-4456-8614-5420a6883559 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:07.840047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adfe3ca-e5c0-4456-8614-5420a6883559 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:07.840169 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adfe3ca-e5c0-4456-8614-5420a6883559 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:07.840574 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adfe3ca-e5c0-4456-8614-5420a6883559 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:07.995169 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5adfe3ca-e5c0-4456-8614-5420a6883559 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:08.003996 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5adfe3ca-e5c0-4456-8614-5420a6883559 tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1504 microversion: 2.1 time: 0.177305 Sep 19 17:26:08.004569 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 212/421] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:07 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:08.166135 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6777f447-cca1-45b1-aaa8-6be890831312 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:08.167468 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6777f447-cca1-45b1-aaa8-6be890831312 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:08.173605 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6777f447-cca1-45b1-aaa8-6be890831312 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:08.178973 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6777f447-cca1-45b1-aaa8-6be890831312 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:08.178973 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6777f447-cca1-45b1-aaa8-6be890831312 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:08.178973 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6777f447-cca1-45b1-aaa8-6be890831312 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:08.178973 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6777f447-cca1-45b1-aaa8-6be890831312 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:08.179342 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6777f447-cca1-45b1-aaa8-6be890831312 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:08.369341 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5bca7569-75d1-412c-9924-14312144f257 req-31272e26-9154-4d3b-961c-4762cc256f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3986658-9450-4b09-86ac-4d112cca8b0e", "name": "network-vif-deleted", "tag": "99d1a0de-3284-4970-a396-349166d75d19"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:26:08.382897 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5bca7569-75d1-412c-9924-14312144f257 req-31272e26-9154-4d3b-961c-4762cc256f36 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:08.383594 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5bca7569-75d1-412c-9924-14312144f257 req-31272e26-9154-4d3b-961c-4762cc256f36 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:08.384132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5bca7569-75d1-412c-9924-14312144f257 req-31272e26-9154-4d3b-961c-4762cc256f36 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:08.397845 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5bca7569-75d1-412c-9924-14312144f257 req-31272e26-9154-4d3b-961c-4762cc256f36 service nova] Creating event network-vif-deleted:99d1a0de-3284-4970-a396-349166d75d19 for instance e3986658-9450-4b09-86ac-4d112cca8b0e on hv-cinder-84801 Sep 19 17:26:08.403687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5bca7569-75d1-412c-9924-14312144f257 req-31272e26-9154-4d3b-961c-4762cc256f36 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048207 Sep 19 17:26:08.407465 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6777f447-cca1-45b1-aaa8-6be890831312 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:08.412570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 213/422] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:26:08.415824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6777f447-cca1-45b1-aaa8-6be890831312 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.254310 Sep 19 17:26:08.416420 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 210/423] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:08 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:09.043920 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:09.044780 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:09.052463 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:09.052877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:09.055295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:09.055295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:09.055295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:09.055295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:09.106578 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:09.107069 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:09.107507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:09.107987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lazy-loading 'fault' on Instance uuid e3986658-9450-4b09-86ac-4d112cca8b0e {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:26:09.160304 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b26d6cd2fc4657bb9682065168cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a7d164d1343aa95087e1d4b5ebb11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:09.170221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-32437705-bc99-4dc7-a495-7423078bf4ae tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 200 len: 1304 microversion: 2.1 time: 0.143515 Sep 19 17:26:09.170809 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 214/424] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:09 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:09.438692 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a1d10e6b-9fc9-4de8-b5a9-8ad2e185cf47 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:09.439311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1d10e6b-9fc9-4de8-b5a9-8ad2e185cf47 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:09.445476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1d10e6b-9fc9-4de8-b5a9-8ad2e185cf47 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:09.446013 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1d10e6b-9fc9-4de8-b5a9-8ad2e185cf47 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:09.446448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1d10e6b-9fc9-4de8-b5a9-8ad2e185cf47 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:09.447142 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1d10e6b-9fc9-4de8-b5a9-8ad2e185cf47 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:09.447597 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1d10e6b-9fc9-4de8-b5a9-8ad2e185cf47 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:09.448050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1d10e6b-9fc9-4de8-b5a9-8ad2e185cf47 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:09.602185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a1d10e6b-9fc9-4de8-b5a9-8ad2e185cf47 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:09.610675 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a1d10e6b-9fc9-4de8-b5a9-8ad2e185cf47 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.175797 Sep 19 17:26:09.611518 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 211/425] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:09 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:10.194572 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:10.197315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] [instance: e3986658-9450-4b09-86ac-4d112cca8b0e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:10.206484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:10.207017 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:10.207645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:10.208658 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:10.209374 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:10.210039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:10.226372 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] HTTP exception thrown: Instance e3986658-9450-4b09-86ac-4d112cca8b0e could not be found. Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Request method failure captured: Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e HTTP/1.1 Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKXNDK_zmjiwKVXTc5PH5KuDwSlaFF2aZAg_I2Q5D-Y2ZJvsvsUkSDrpHqo6jArSuS3NkmaavHaxaxzBMTw0rKOT9NVtk_I-0pOs7Q_FuEZ2trJgQvD223DtQ9Hw8LpCBsLrgB73-PXR2ehotmdplDTq9apwrwe1xCr9hQr2iJppwdI Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 521a7d164d1343aa95087e1d4b5ebb11 Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesActionsTest-553757696 Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:26:10.228054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_521a7d164d1343aa95087e1d4b5ebb11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/521a7d164d1343aa95087e1d4b5ebb11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/521a7d164d1343aa95087e1d4b5ebb11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/521a7d164d1343aa95087e1d4b5ebb11"}]}] Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-VolumesActionsTest-553757696 Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 521a7d164d1343aa95087e1d4b5ebb11 Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesActionsTest-553757696 Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-VolumesActionsTest-553757696-project Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 12b26d6cd2fc4657bb9682065168cd71 Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-VolumesActionsTest-553757696-project Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance e3986658-9450-4b09-86ac-4d112cca8b0e could not be found. Sep 19 17:26:10.230129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': 'e3986658-9450-4b09-86ac-4d112cca8b0e'} Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3986658-9450-4b09-86ac-4d112cca8b0e could not be found. Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:26:10.231125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3986658-9450-4b09-86ac-4d112cca8b0e could not be found. Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3986658-9450-4b09-86ac-4d112cca8b0e could not be found. Sep 19 17:26:10.232806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:26:10.236127 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] Returning 404 to user: Instance e3986658-9450-4b09-86ac-4d112cca8b0e could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:26:10.236127 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f35b3178-57eb-4e3d-982c-bf5179ea9dad tempest-VolumesActionsTest-553757696 tempest-VolumesActionsTest-553757696-project] 10.222.0.61 "GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e" status: 404 len: 111 microversion: 2.1 time: 0.038856 Sep 19 17:26:10.236127 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 215/426] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:10 2022] GET /compute/v2.1/servers/e3986658-9450-4b09-86ac-4d112cca8b0e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:26:10.634077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c3b1f22d-2b9b-4750-84e1-2d31bd7a437e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:10.634934 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c3b1f22d-2b9b-4750-84e1-2d31bd7a437e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:10.644338 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b1f22d-2b9b-4750-84e1-2d31bd7a437e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:10.645130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b1f22d-2b9b-4750-84e1-2d31bd7a437e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:10.646538 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b1f22d-2b9b-4750-84e1-2d31bd7a437e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:10.646538 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b1f22d-2b9b-4750-84e1-2d31bd7a437e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:10.646973 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b1f22d-2b9b-4750-84e1-2d31bd7a437e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:10.647414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b1f22d-2b9b-4750-84e1-2d31bd7a437e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:10.778452 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c3b1f22d-2b9b-4750-84e1-2d31bd7a437e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:10.786279 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c3b1f22d-2b9b-4750-84e1-2d31bd7a437e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.156137 Sep 19 17:26:10.786712 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 212/427] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:10 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:11.810212 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e908be1a-4e9d-48b7-9acd-86b43af819b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:11.810747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e908be1a-4e9d-48b7-9acd-86b43af819b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:11.817380 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e908be1a-4e9d-48b7-9acd-86b43af819b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:11.817863 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e908be1a-4e9d-48b7-9acd-86b43af819b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:11.818299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e908be1a-4e9d-48b7-9acd-86b43af819b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:11.818993 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e908be1a-4e9d-48b7-9acd-86b43af819b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:11.819448 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e908be1a-4e9d-48b7-9acd-86b43af819b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:11.819905 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e908be1a-4e9d-48b7-9acd-86b43af819b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:11.956728 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e908be1a-4e9d-48b7-9acd-86b43af819b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:11.964859 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e908be1a-4e9d-48b7-9acd-86b43af819b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.158692 Sep 19 17:26:11.965419 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 216/428] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:11 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:12.991298 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-658ea312-6939-42cf-8a1d-61bb9316dea9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:12.992320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-658ea312-6939-42cf-8a1d-61bb9316dea9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:12.999121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-658ea312-6939-42cf-8a1d-61bb9316dea9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:12.999612 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-658ea312-6939-42cf-8a1d-61bb9316dea9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:13.000086 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-658ea312-6939-42cf-8a1d-61bb9316dea9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:13.000794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-658ea312-6939-42cf-8a1d-61bb9316dea9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:13.001254 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-658ea312-6939-42cf-8a1d-61bb9316dea9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:13.001770 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-658ea312-6939-42cf-8a1d-61bb9316dea9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:13.138812 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-658ea312-6939-42cf-8a1d-61bb9316dea9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:13.147160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-658ea312-6939-42cf-8a1d-61bb9316dea9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.159796 Sep 19 17:26:13.147775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 213/429] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:12 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:14.170406 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2ff88bc-2573-4250-be80-b7f0840188bc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:14.170971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b2ff88bc-2573-4250-be80-b7f0840188bc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:14.177394 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ff88bc-2573-4250-be80-b7f0840188bc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:14.177879 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ff88bc-2573-4250-be80-b7f0840188bc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:14.178318 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ff88bc-2573-4250-be80-b7f0840188bc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:14.179012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ff88bc-2573-4250-be80-b7f0840188bc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:14.179475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ff88bc-2573-4250-be80-b7f0840188bc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:14.179931 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2ff88bc-2573-4250-be80-b7f0840188bc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:14.308027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b2ff88bc-2573-4250-be80-b7f0840188bc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:14.316906 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2ff88bc-2573-4250-be80-b7f0840188bc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.150482 Sep 19 17:26:14.317473 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 217/430] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:14 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:15.340758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8b6e402c-63ef-4acb-aa6f-6655685360e7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:15.341329 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8b6e402c-63ef-4acb-aa6f-6655685360e7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:15.348631 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6e402c-63ef-4acb-aa6f-6655685360e7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:15.349159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6e402c-63ef-4acb-aa6f-6655685360e7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:15.349608 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6e402c-63ef-4acb-aa6f-6655685360e7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:15.350323 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6e402c-63ef-4acb-aa6f-6655685360e7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:15.350784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6e402c-63ef-4acb-aa6f-6655685360e7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:15.351220 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6e402c-63ef-4acb-aa6f-6655685360e7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:15.482756 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8b6e402c-63ef-4acb-aa6f-6655685360e7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:15.490457 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8b6e402c-63ef-4acb-aa6f-6655685360e7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.153668 Sep 19 17:26:15.491027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 214/431] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:15 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:16.514041 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a69362ae-2390-4dfe-85a3-376589a1c46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:16.514643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a69362ae-2390-4dfe-85a3-376589a1c46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:16.521339 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a69362ae-2390-4dfe-85a3-376589a1c46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:16.521817 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a69362ae-2390-4dfe-85a3-376589a1c46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:16.522246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a69362ae-2390-4dfe-85a3-376589a1c46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:16.522928 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a69362ae-2390-4dfe-85a3-376589a1c46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:16.523376 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a69362ae-2390-4dfe-85a3-376589a1c46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:16.523822 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a69362ae-2390-4dfe-85a3-376589a1c46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:16.649918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a69362ae-2390-4dfe-85a3-376589a1c46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:16.658118 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a69362ae-2390-4dfe-85a3-376589a1c46b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.147896 Sep 19 17:26:16.658700 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 218/432] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:16 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:17.681007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a5f7286f-f17a-4fd4-ab75-80662bbe495f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:17.681605 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a5f7286f-f17a-4fd4-ab75-80662bbe495f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:17.688291 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f7286f-f17a-4fd4-ab75-80662bbe495f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:17.688777 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f7286f-f17a-4fd4-ab75-80662bbe495f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:17.689218 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f7286f-f17a-4fd4-ab75-80662bbe495f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:17.689990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f7286f-f17a-4fd4-ab75-80662bbe495f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:17.690449 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f7286f-f17a-4fd4-ab75-80662bbe495f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:17.690877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f7286f-f17a-4fd4-ab75-80662bbe495f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:17.826633 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a5f7286f-f17a-4fd4-ab75-80662bbe495f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:17.834733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a5f7286f-f17a-4fd4-ab75-80662bbe495f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.157622 Sep 19 17:26:17.835296 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 215/433] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:17 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:18.859052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d41a75e4-3ae3-4f8c-8cf0-a5c27cb67664 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:18.859874 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d41a75e4-3ae3-4f8c-8cf0-a5c27cb67664 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:18.866535 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d41a75e4-3ae3-4f8c-8cf0-a5c27cb67664 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:18.867021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d41a75e4-3ae3-4f8c-8cf0-a5c27cb67664 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:18.867462 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d41a75e4-3ae3-4f8c-8cf0-a5c27cb67664 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:18.868176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d41a75e4-3ae3-4f8c-8cf0-a5c27cb67664 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:18.868632 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d41a75e4-3ae3-4f8c-8cf0-a5c27cb67664 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:18.869078 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d41a75e4-3ae3-4f8c-8cf0-a5c27cb67664 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:19.001834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d41a75e4-3ae3-4f8c-8cf0-a5c27cb67664 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:19.009414 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d41a75e4-3ae3-4f8c-8cf0-a5c27cb67664 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.154860 Sep 19 17:26:19.009979 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 219/434] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:18 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:20.033202 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6fc336f5-0e15-4fec-97c9-b4746b98f3d6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:20.033746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6fc336f5-0e15-4fec-97c9-b4746b98f3d6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:20.039811 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fc336f5-0e15-4fec-97c9-b4746b98f3d6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:20.040402 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fc336f5-0e15-4fec-97c9-b4746b98f3d6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:20.040836 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fc336f5-0e15-4fec-97c9-b4746b98f3d6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:20.041530 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fc336f5-0e15-4fec-97c9-b4746b98f3d6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:20.041983 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fc336f5-0e15-4fec-97c9-b4746b98f3d6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:20.042410 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fc336f5-0e15-4fec-97c9-b4746b98f3d6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:20.168980 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6fc336f5-0e15-4fec-97c9-b4746b98f3d6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:20.176685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6fc336f5-0e15-4fec-97c9-b4746b98f3d6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.148022 Sep 19 17:26:20.177263 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 216/435] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:20 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:21.202965 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8ea86f7-2531-4e32-a4ad-866870f67f13 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:21.203504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8ea86f7-2531-4e32-a4ad-866870f67f13 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:21.213692 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8ea86f7-2531-4e32-a4ad-866870f67f13 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:21.214827 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8ea86f7-2531-4e32-a4ad-866870f67f13 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:21.215534 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8ea86f7-2531-4e32-a4ad-866870f67f13 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:21.216754 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8ea86f7-2531-4e32-a4ad-866870f67f13 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:21.218522 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8ea86f7-2531-4e32-a4ad-866870f67f13 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:21.219434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8ea86f7-2531-4e32-a4ad-866870f67f13 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:21.436501 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a8ea86f7-2531-4e32-a4ad-866870f67f13 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:21.446926 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a8ea86f7-2531-4e32-a4ad-866870f67f13 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.249056 Sep 19 17:26:21.448138 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 220/436] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:21 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:22.471209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-18f7ccd4-619a-45f9-b67e-9dd758f270a9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:22.471870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-18f7ccd4-619a-45f9-b67e-9dd758f270a9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:22.482023 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18f7ccd4-619a-45f9-b67e-9dd758f270a9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:22.482514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18f7ccd4-619a-45f9-b67e-9dd758f270a9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:22.482970 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18f7ccd4-619a-45f9-b67e-9dd758f270a9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:22.484483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18f7ccd4-619a-45f9-b67e-9dd758f270a9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:22.485121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18f7ccd4-619a-45f9-b67e-9dd758f270a9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:22.485567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18f7ccd4-619a-45f9-b67e-9dd758f270a9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:22.633305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-18f7ccd4-619a-45f9-b67e-9dd758f270a9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:22.642808 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-18f7ccd4-619a-45f9-b67e-9dd758f270a9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.176024 Sep 19 17:26:22.644005 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 217/437] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:22 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:23.666965 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0655a74b-e3b5-406f-94fb-c7e6da0fec33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:23.668264 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0655a74b-e3b5-406f-94fb-c7e6da0fec33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:23.676160 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0655a74b-e3b5-406f-94fb-c7e6da0fec33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:23.679340 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0655a74b-e3b5-406f-94fb-c7e6da0fec33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:23.679836 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0655a74b-e3b5-406f-94fb-c7e6da0fec33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:23.683399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0655a74b-e3b5-406f-94fb-c7e6da0fec33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:23.690548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0655a74b-e3b5-406f-94fb-c7e6da0fec33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:23.691195 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0655a74b-e3b5-406f-94fb-c7e6da0fec33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:23.937322 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0655a74b-e3b5-406f-94fb-c7e6da0fec33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:23.941136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0655a74b-e3b5-406f-94fb-c7e6da0fec33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.277753 Sep 19 17:26:23.941971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 221/438] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:23 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:26:24.971131 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0bde16b0-a1b0-4b24-b46d-70fed2848f37 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:24.973291 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0bde16b0-a1b0-4b24-b46d-70fed2848f37 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:24.979449 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:24.981184 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bde16b0-a1b0-4b24-b46d-70fed2848f37 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:24.981911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bde16b0-a1b0-4b24-b46d-70fed2848f37 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:24.982797 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bde16b0-a1b0-4b24-b46d-70fed2848f37 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:24.983991 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bde16b0-a1b0-4b24-b46d-70fed2848f37 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:24.984658 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bde16b0-a1b0-4b24-b46d-70fed2848f37 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:24.985095 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bde16b0-a1b0-4b24-b46d-70fed2848f37 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:25.134014 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0bde16b0-a1b0-4b24-b46d-70fed2848f37 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:25.156074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0bde16b0-a1b0-4b24-b46d-70fed2848f37 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1502 microversion: 2.1 time: 0.178581 Sep 19 17:26:25.156074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 218/439] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:24 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:25.173440 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e894a062-b9d1-4777-ad62-f72439a8ec29"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:26:25.175817 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:25.191185 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:25.192088 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:25.192813 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:25.197805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:25.198474 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:25.199077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:25.248372 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] HTTP exception thrown: Cannot 'attach_volume' instance 16c05ebb-0e1d-4420-b50a-c289b41715da while it is in vm_state rescued Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Request method failure captured: Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da/os-volume_attachments HTTP/1.1 Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 74 Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWMWEfop28VzjVJxhEt1SrAA6vyu-Djio5TQQ93Op_5LUruPf_K-j6q9Ueg4oIQCsMrIXevBlXeqOdKnn9vWSqE1F-p6cnVQWlCOcxrCZxCtS7BtyW145HEy0dAywADtm3t4USmgSJLNoWRwvsKSouHGmnzxc_QEXYcwdBWu0ZBG_s Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 4118102ca29c4b0fa344b21b9c9f1e85 Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:26:25.250531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4118102ca29c4b0fa344b21b9c9f1e85"}]}] Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 4118102ca29c4b0fa344b21b9c9f1e85 Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-ServerRescueNegativeTestJSON-847106187-project Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 4f460a4884d1486484a683f440459b6e Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-847106187-project Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {"volumeAttachment": {"volumeId": "e894a062-b9d1-4777-ad62-f72439a8ec29"}} Sep 19 17:26:25.255877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Cannot 'attach_volume' instance 16c05ebb-0e1d-4420-b50a-c289b41715da while it is in vm_state rescued Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'server_id': '16c05ebb-0e1d-4420-b50a-c289b41715da', 'body': {'volumeAttachment': {'volumeId': 'e894a062-b9d1-4777-ad62-f72439a8ec29'}}} Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16c05ebb-0e1d-4420-b50a-c289b41715da in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:26:25.256835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 16c05ebb-0e1d-4420-b50a-c289b41715da while it is in vm_state rescued Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:26:25.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:26:25.259475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:26:25.259475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:26:25.259475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 16c05ebb-0e1d-4420-b50a-c289b41715da while it is in vm_state rescued Sep 19 17:26:25.259475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:26:25.259475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Returning 409 to user: Cannot 'attach_volume' instance 16c05ebb-0e1d-4420-b50a-c289b41715da while it is in vm_state rescued {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:26:25.259475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e32fe332-04b6-4bef-8b09-307f7d1f7d4d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "POST /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.083314 Sep 19 17:26:25.259475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 222/440] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:26:25 2022] POST /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da/os-volume_attachments => generated 152 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 17:26:25.264085 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b4e39413-792b-4732-82c4-7deae5243930 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:26:25.265170 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b4e39413-792b-4732-82c4-7deae5243930 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:25.272340 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e39413-792b-4732-82c4-7deae5243930 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:25.273027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e39413-792b-4732-82c4-7deae5243930 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:25.273640 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e39413-792b-4732-82c4-7deae5243930 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:25.274665 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e39413-792b-4732-82c4-7deae5243930 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:25.275070 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e39413-792b-4732-82c4-7deae5243930 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:25.275501 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e39413-792b-4732-82c4-7deae5243930 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:25.586550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b4e39413-792b-4732-82c4-7deae5243930 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "POST /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da/action" status: 202 len: 0 microversion: 2.1 time: 0.328239 Sep 19 17:26:25.587729 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 219/441] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:26:25 2022] POST /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:26:25.596210 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8891b352-cfbf-4cd0-a9cf-5b5109825df8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:25.597139 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8891b352-cfbf-4cd0-a9cf-5b5109825df8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:25.603898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8891b352-cfbf-4cd0-a9cf-5b5109825df8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:25.604671 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8891b352-cfbf-4cd0-a9cf-5b5109825df8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:25.605281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8891b352-cfbf-4cd0-a9cf-5b5109825df8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:25.606185 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8891b352-cfbf-4cd0-a9cf-5b5109825df8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:25.606793 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8891b352-cfbf-4cd0-a9cf-5b5109825df8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:25.607373 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8891b352-cfbf-4cd0-a9cf-5b5109825df8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:25.774119 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8891b352-cfbf-4cd0-a9cf-5b5109825df8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:25.782611 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8891b352-cfbf-4cd0-a9cf-5b5109825df8 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1510 microversion: 2.1 time: 0.190850 Sep 19 17:26:25.790361 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 223/442] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:25 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:26.807627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d74017a5-5121-4419-9524-a0cdafb99fff tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:26.808876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d74017a5-5121-4419-9524-a0cdafb99fff tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:26.817789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74017a5-5121-4419-9524-a0cdafb99fff tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:26.818321 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74017a5-5121-4419-9524-a0cdafb99fff tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:26.819002 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74017a5-5121-4419-9524-a0cdafb99fff tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:26.820027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74017a5-5121-4419-9524-a0cdafb99fff tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:26.820663 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74017a5-5121-4419-9524-a0cdafb99fff tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:26.821413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74017a5-5121-4419-9524-a0cdafb99fff tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:26.826513 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:27.023591 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d74017a5-5121-4419-9524-a0cdafb99fff tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:27.034644 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d74017a5-5121-4419-9524-a0cdafb99fff tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1510 microversion: 2.1 time: 0.231963 Sep 19 17:26:27.035218 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 220/443] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:26 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:28.062554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3506679-b8ac-4e5f-816f-659b95f42156 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:28.064064 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e3506679-b8ac-4e5f-816f-659b95f42156 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:28.071347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3506679-b8ac-4e5f-816f-659b95f42156 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:28.071873 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3506679-b8ac-4e5f-816f-659b95f42156 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:28.072463 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3506679-b8ac-4e5f-816f-659b95f42156 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:28.073345 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3506679-b8ac-4e5f-816f-659b95f42156 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:28.074034 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3506679-b8ac-4e5f-816f-659b95f42156 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:28.074610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3506679-b8ac-4e5f-816f-659b95f42156 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:28.251922 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e3506679-b8ac-4e5f-816f-659b95f42156 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:28.260899 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e3506679-b8ac-4e5f-816f-659b95f42156 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1510 microversion: 2.1 time: 0.204170 Sep 19 17:26:28.261477 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 224/444] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:28 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:29.286785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-64a6a19a-6438-4b7e-8a47-e01bb19b7ba9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:29.288020 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64a6a19a-6438-4b7e-8a47-e01bb19b7ba9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:29.297467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a6a19a-6438-4b7e-8a47-e01bb19b7ba9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:29.297979 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a6a19a-6438-4b7e-8a47-e01bb19b7ba9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:29.299064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a6a19a-6438-4b7e-8a47-e01bb19b7ba9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:29.300298 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a6a19a-6438-4b7e-8a47-e01bb19b7ba9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:29.301010 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a6a19a-6438-4b7e-8a47-e01bb19b7ba9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:29.301639 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a6a19a-6438-4b7e-8a47-e01bb19b7ba9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:29.480628 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-64a6a19a-6438-4b7e-8a47-e01bb19b7ba9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:29.490597 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-64a6a19a-6438-4b7e-8a47-e01bb19b7ba9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1510 microversion: 2.1 time: 0.207567 Sep 19 17:26:29.491351 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 221/445] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:29 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:30.515008 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-68eb0eab-a6bf-49df-b4f6-7c640b1e3e2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:30.515637 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-68eb0eab-a6bf-49df-b4f6-7c640b1e3e2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:30.523836 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68eb0eab-a6bf-49df-b4f6-7c640b1e3e2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:30.529005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68eb0eab-a6bf-49df-b4f6-7c640b1e3e2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:30.529005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68eb0eab-a6bf-49df-b4f6-7c640b1e3e2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:30.529005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68eb0eab-a6bf-49df-b4f6-7c640b1e3e2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:30.529005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68eb0eab-a6bf-49df-b4f6-7c640b1e3e2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:30.529423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68eb0eab-a6bf-49df-b4f6-7c640b1e3e2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:30.700478 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-68eb0eab-a6bf-49df-b4f6-7c640b1e3e2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:30.711772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-68eb0eab-a6bf-49df-b4f6-7c640b1e3e2b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1510 microversion: 2.1 time: 0.201039 Sep 19 17:26:30.713357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 225/446] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:30 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:31.737346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d294a8f-8515-4305-83e7-c23e422095ef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:31.738053 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d294a8f-8515-4305-83e7-c23e422095ef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:31.745008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d294a8f-8515-4305-83e7-c23e422095ef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:31.745643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d294a8f-8515-4305-83e7-c23e422095ef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:31.746623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d294a8f-8515-4305-83e7-c23e422095ef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:31.747360 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d294a8f-8515-4305-83e7-c23e422095ef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:31.748222 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d294a8f-8515-4305-83e7-c23e422095ef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:31.749364 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d294a8f-8515-4305-83e7-c23e422095ef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:31.890964 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d294a8f-8515-4305-83e7-c23e422095ef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:31.901950 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d294a8f-8515-4305-83e7-c23e422095ef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1516 microversion: 2.1 time: 0.169605 Sep 19 17:26:31.902599 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 222/447] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:31 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:34.628718 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-30cc1c27-5fc2-4de8-9207-473caba6c032 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Action: 'create', calling method: .version_select at 0x7fd4d60a7790>, body: {"keypair": {"name": "tempest-keypair-647718401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH06cyapU9qF3bdQKt+ygAjUKf9dCQ5Xrrj7GkEArvMR+sV4u9YTQXVvcieqceOav2A1+o5RUmL4YGFoDN9B58zuPMU+2UnsfTdz0Kr7mZKQI2a2Cea5OztIClXX6CX3Sg=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:26:34.646899 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-30cc1c27-5fc2-4de8-9207-473caba6c032 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Getting quotas for project 4118102ca29c4b0fa344b21b9c9f1e85. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:26:34.651219 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-30cc1c27-5fc2-4de8-9207-473caba6c032 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Getting quotas for user 4f460a4884d1486484a683f440459b6e and project 4118102ca29c4b0fa344b21b9c9f1e85. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:26:34.721616 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-30cc1c27-5fc2-4de8-9207-473caba6c032 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096602 Sep 19 17:26:34.722379 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 226/448] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Sep 19 17:26:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:26:35.920381 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f51b87f5-7b48-47b6-b200-00827f448fec tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b4ff649-3006-47b4-ab15-a781ae590b11", "device": "/dev/sdb"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:26:35.926423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f51b87f5-7b48-47b6-b200-00827f448fec tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:35.937451 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51b87f5-7b48-47b6-b200-00827f448fec tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:35.938021 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51b87f5-7b48-47b6-b200-00827f448fec tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:35.938508 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51b87f5-7b48-47b6-b200-00827f448fec tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:35.939405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51b87f5-7b48-47b6-b200-00827f448fec tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:35.940155 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51b87f5-7b48-47b6-b200-00827f448fec tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:35.940974 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51b87f5-7b48-47b6-b200-00827f448fec tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:36.680498 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f51b87f5-7b48-47b6-b200-00827f448fec tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "POST /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.763487 Sep 19 17:26:36.690864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 223/449] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:26:35 2022] POST /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:26:37.096204 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1381163573", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fecf8741-4aac-48fd-b6b2-d491a4c0d8d5"}], "security_groups": [{"name": "tempest-securitygroup--1368502402"}], "key_name": "tempest-keypair-647718401", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:26:37.106954 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:37.221101 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] validate_networks() for [('fecf8741-4aac-48fd-b6b2-d491a4c0d8d5', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:26:37.620795 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:26:37.621648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:26:37.622299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:26:37.622797 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:26:37.623293 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:26:37.633438 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:37.633942 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:37.634427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:37.635159 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:37.635782 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:37.636242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:37.648755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=93 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:37.659131 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Getting quotas for project 4118102ca29c4b0fa344b21b9c9f1e85. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:26:37.663245 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Getting quotas for user 4f460a4884d1486484a683f440459b6e and project 4118102ca29c4b0fa344b21b9c9f1e85. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:26:37.675130 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:26:37.677638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:26:37.826380 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af8e45e9-bf6b-4963-b3d5-5894ad4ef2c6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.735095 Sep 19 17:26:37.833546 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 227/450] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:26:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:26:37.847315 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c88b911c-174c-46d8-b0d9-71410c255ee5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:37.860777 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c88b911c-174c-46d8-b0d9-71410c255ee5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:37.937847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c88b911c-174c-46d8-b0d9-71410c255ee5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:37.945234 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c88b911c-174c-46d8-b0d9-71410c255ee5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1245 microversion: 2.1 time: 0.108779 Sep 19 17:26:37.958957 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 224/451] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:37 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:38.972513 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47e9dc8c-64e0-43a6-8a7e-9b450e9eb83d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:38.974173 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47e9dc8c-64e0-43a6-8a7e-9b450e9eb83d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:38.985589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e9dc8c-64e0-43a6-8a7e-9b450e9eb83d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:38.986174 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e9dc8c-64e0-43a6-8a7e-9b450e9eb83d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:38.989342 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e9dc8c-64e0-43a6-8a7e-9b450e9eb83d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:38.989342 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e9dc8c-64e0-43a6-8a7e-9b450e9eb83d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:38.989342 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e9dc8c-64e0-43a6-8a7e-9b450e9eb83d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:38.989342 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e9dc8c-64e0-43a6-8a7e-9b450e9eb83d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:39.077430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-47e9dc8c-64e0-43a6-8a7e-9b450e9eb83d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:39.085273 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47e9dc8c-64e0-43a6-8a7e-9b450e9eb83d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1249 microversion: 2.1 time: 0.119288 Sep 19 17:26:39.086040 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 228/452] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:38 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1249 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:40.114019 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f71dc653-5e78-490e-bea7-450a8eaa798c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:40.114712 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f71dc653-5e78-490e-bea7-450a8eaa798c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:40.134314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71dc653-5e78-490e-bea7-450a8eaa798c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:40.134936 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71dc653-5e78-490e-bea7-450a8eaa798c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:40.135685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71dc653-5e78-490e-bea7-450a8eaa798c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:40.136511 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71dc653-5e78-490e-bea7-450a8eaa798c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:40.138575 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71dc653-5e78-490e-bea7-450a8eaa798c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:40.139257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71dc653-5e78-490e-bea7-450a8eaa798c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:40.204444 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f71dc653-5e78-490e-bea7-450a8eaa798c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:40.213333 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f71dc653-5e78-490e-bea7-450a8eaa798c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1297 microversion: 2.1 time: 0.103635 Sep 19 17:26:40.214278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 225/453] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:40 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:41.237124 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f11dac6-7265-495c-98b8-d9a6ab5da7dd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:41.237887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f11dac6-7265-495c-98b8-d9a6ab5da7dd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:41.246957 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f11dac6-7265-495c-98b8-d9a6ab5da7dd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:41.247773 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f11dac6-7265-495c-98b8-d9a6ab5da7dd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:41.248964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f11dac6-7265-495c-98b8-d9a6ab5da7dd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:41.249898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f11dac6-7265-495c-98b8-d9a6ab5da7dd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:41.250552 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f11dac6-7265-495c-98b8-d9a6ab5da7dd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:41.251196 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f11dac6-7265-495c-98b8-d9a6ab5da7dd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:41.318856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f11dac6-7265-495c-98b8-d9a6ab5da7dd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:41.349247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f11dac6-7265-495c-98b8-d9a6ab5da7dd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1303 microversion: 2.1 time: 0.115448 Sep 19 17:26:41.350646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 229/454] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:41 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:26:42.395079 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a0f1925-5e62-439d-b8df-2cfe129a7500 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:42.396962 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a0f1925-5e62-439d-b8df-2cfe129a7500 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:42.402001 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 17:26:42.402202 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Mon Sep 19 17:26:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a (ip 10.222.0.61) !!! Sep 19 17:26:42.419989 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0f1925-5e62-439d-b8df-2cfe129a7500 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:42.420887 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0f1925-5e62-439d-b8df-2cfe129a7500 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:42.421337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0f1925-5e62-439d-b8df-2cfe129a7500 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:42.422055 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0f1925-5e62-439d-b8df-2cfe129a7500 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:42.422516 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0f1925-5e62-439d-b8df-2cfe129a7500 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:42.422945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0f1925-5e62-439d-b8df-2cfe129a7500 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:42.574377 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a0f1925-5e62-439d-b8df-2cfe129a7500 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:42.583244 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a0f1925-5e62-439d-b8df-2cfe129a7500 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.196397 Sep 19 17:26:42.595889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 226/455] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:42 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:42.765601 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-598c770f-ebd6-4c54-bbd1-9b3707fd1b48 req-efdc3c55-47cd-4d50-af17-452ff4da6d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2632c0f-04a3-4b90-b4b1-f8989649a34a", "tag": "8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:26:42.779483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-598c770f-ebd6-4c54-bbd1-9b3707fd1b48 req-efdc3c55-47cd-4d50-af17-452ff4da6d1d service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:42.780263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-598c770f-ebd6-4c54-bbd1-9b3707fd1b48 req-efdc3c55-47cd-4d50-af17-452ff4da6d1d service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:42.780907 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-598c770f-ebd6-4c54-bbd1-9b3707fd1b48 req-efdc3c55-47cd-4d50-af17-452ff4da6d1d service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:42.793018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-598c770f-ebd6-4c54-bbd1-9b3707fd1b48 req-efdc3c55-47cd-4d50-af17-452ff4da6d1d service nova] Creating event network-changed:8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0 for instance f2632c0f-04a3-4b90-b4b1-f8989649a34a on hv-cinder-84801 Sep 19 17:26:42.798019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-598c770f-ebd6-4c54-bbd1-9b3707fd1b48 req-efdc3c55-47cd-4d50-af17-452ff4da6d1d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037742 Sep 19 17:26:42.798916 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 230/456] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:26:43.608505 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ed9b0a6e-34e6-4226-b7d3-675e364b1ec4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:43.609130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed9b0a6e-34e6-4226-b7d3-675e364b1ec4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:43.615446 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed9b0a6e-34e6-4226-b7d3-675e364b1ec4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:43.616037 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed9b0a6e-34e6-4226-b7d3-675e364b1ec4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:43.616463 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed9b0a6e-34e6-4226-b7d3-675e364b1ec4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:43.617167 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed9b0a6e-34e6-4226-b7d3-675e364b1ec4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:43.617673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed9b0a6e-34e6-4226-b7d3-675e364b1ec4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:43.618049 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed9b0a6e-34e6-4226-b7d3-675e364b1ec4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:43.749333 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ed9b0a6e-34e6-4226-b7d3-675e364b1ec4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:43.757159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ed9b0a6e-34e6-4226-b7d3-675e364b1ec4 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.153315 Sep 19 17:26:43.757734 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 227/457] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:43 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:44.782639 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34ff5610-8b6e-40a4-bdcc-e85c32818d2e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:44.783869 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-34ff5610-8b6e-40a4-bdcc-e85c32818d2e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:44.792588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ff5610-8b6e-40a4-bdcc-e85c32818d2e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:44.793696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ff5610-8b6e-40a4-bdcc-e85c32818d2e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:44.794148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ff5610-8b6e-40a4-bdcc-e85c32818d2e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:44.794999 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ff5610-8b6e-40a4-bdcc-e85c32818d2e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:44.795501 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ff5610-8b6e-40a4-bdcc-e85c32818d2e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:44.796004 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ff5610-8b6e-40a4-bdcc-e85c32818d2e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:44.945948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-34ff5610-8b6e-40a4-bdcc-e85c32818d2e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:44.955716 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-34ff5610-8b6e-40a4-bdcc-e85c32818d2e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.178413 Sep 19 17:26:44.956645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 231/458] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:44 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:45.978901 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95e84160-c99f-4025-8136-caf050de2bdd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:45.979515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95e84160-c99f-4025-8136-caf050de2bdd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:45.986012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e84160-c99f-4025-8136-caf050de2bdd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:45.986513 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e84160-c99f-4025-8136-caf050de2bdd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:45.986936 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e84160-c99f-4025-8136-caf050de2bdd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:45.987627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e84160-c99f-4025-8136-caf050de2bdd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:45.988107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e84160-c99f-4025-8136-caf050de2bdd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:45.988533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e84160-c99f-4025-8136-caf050de2bdd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:46.118806 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-95e84160-c99f-4025-8136-caf050de2bdd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:46.127280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95e84160-c99f-4025-8136-caf050de2bdd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.152270 Sep 19 17:26:46.127897 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 228/459] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:45 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:47.151265 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b44a3b30-4e50-40ea-b407-0d34fa0957dc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:47.151928 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b44a3b30-4e50-40ea-b407-0d34fa0957dc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:47.158973 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b44a3b30-4e50-40ea-b407-0d34fa0957dc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:47.159459 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b44a3b30-4e50-40ea-b407-0d34fa0957dc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:47.159927 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b44a3b30-4e50-40ea-b407-0d34fa0957dc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:47.160627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b44a3b30-4e50-40ea-b407-0d34fa0957dc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:47.161079 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b44a3b30-4e50-40ea-b407-0d34fa0957dc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:47.161567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b44a3b30-4e50-40ea-b407-0d34fa0957dc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:47.294748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b44a3b30-4e50-40ea-b407-0d34fa0957dc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:47.303171 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b44a3b30-4e50-40ea-b407-0d34fa0957dc tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.155884 Sep 19 17:26:47.303751 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 232/460] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:47 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:48.326462 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-62b4be8a-c18c-4b3b-937c-7b82a9e92116 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:48.327099 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-62b4be8a-c18c-4b3b-937c-7b82a9e92116 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:48.329462 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:48.334262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62b4be8a-c18c-4b3b-937c-7b82a9e92116 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:48.334789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62b4be8a-c18c-4b3b-937c-7b82a9e92116 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:48.342310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62b4be8a-c18c-4b3b-937c-7b82a9e92116 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:48.342310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62b4be8a-c18c-4b3b-937c-7b82a9e92116 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:48.342310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62b4be8a-c18c-4b3b-937c-7b82a9e92116 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:48.342310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62b4be8a-c18c-4b3b-937c-7b82a9e92116 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:48.474524 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-62b4be8a-c18c-4b3b-937c-7b82a9e92116 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:48.482408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-62b4be8a-c18c-4b3b-937c-7b82a9e92116 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.159762 Sep 19 17:26:48.483483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 229/461] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:48 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:49.505419 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b693f4b7-18a1-4c78-b422-3e59d10c360f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:49.506063 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b693f4b7-18a1-4c78-b422-3e59d10c360f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:49.508208 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:49.508916 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=10 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:49.513749 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b693f4b7-18a1-4c78-b422-3e59d10c360f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:49.514243 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b693f4b7-18a1-4c78-b422-3e59d10c360f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:49.514690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b693f4b7-18a1-4c78-b422-3e59d10c360f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:49.515924 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b693f4b7-18a1-4c78-b422-3e59d10c360f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:49.516391 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b693f4b7-18a1-4c78-b422-3e59d10c360f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:49.516823 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b693f4b7-18a1-4c78-b422-3e59d10c360f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:49.645886 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b693f4b7-18a1-4c78-b422-3e59d10c360f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:49.653882 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b693f4b7-18a1-4c78-b422-3e59d10c360f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.152304 Sep 19 17:26:49.654557 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 233/462] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:49 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:50.678246 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2cead758-81f8-460d-8c41-a47050009d1d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:50.678788 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2cead758-81f8-460d-8c41-a47050009d1d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:50.685484 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cead758-81f8-460d-8c41-a47050009d1d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:50.685975 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cead758-81f8-460d-8c41-a47050009d1d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:50.686505 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cead758-81f8-460d-8c41-a47050009d1d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:50.687100 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cead758-81f8-460d-8c41-a47050009d1d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:50.687642 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cead758-81f8-460d-8c41-a47050009d1d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:50.688092 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cead758-81f8-460d-8c41-a47050009d1d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:50.817649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2cead758-81f8-460d-8c41-a47050009d1d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:50.825276 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2cead758-81f8-460d-8c41-a47050009d1d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.150831 Sep 19 17:26:50.825851 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 230/463] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:50 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:51.847908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-acdd83f3-57e8-421f-b6ee-836291a3a0d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:51.848523 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-acdd83f3-57e8-421f-b6ee-836291a3a0d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:51.855132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acdd83f3-57e8-421f-b6ee-836291a3a0d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:51.855516 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acdd83f3-57e8-421f-b6ee-836291a3a0d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:51.855996 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acdd83f3-57e8-421f-b6ee-836291a3a0d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:51.857365 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acdd83f3-57e8-421f-b6ee-836291a3a0d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:51.857849 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acdd83f3-57e8-421f-b6ee-836291a3a0d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:51.858294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acdd83f3-57e8-421f-b6ee-836291a3a0d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:52.002187 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-acdd83f3-57e8-421f-b6ee-836291a3a0d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:52.010082 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-acdd83f3-57e8-421f-b6ee-836291a3a0d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.166054 Sep 19 17:26:52.010806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 234/464] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:51 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:53.033454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-098fa6d8-4667-4663-b7ac-dbb42a191420 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:53.034071 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-098fa6d8-4667-4663-b7ac-dbb42a191420 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:53.040828 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-098fa6d8-4667-4663-b7ac-dbb42a191420 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:53.041314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-098fa6d8-4667-4663-b7ac-dbb42a191420 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:53.041957 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-098fa6d8-4667-4663-b7ac-dbb42a191420 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:53.042672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-098fa6d8-4667-4663-b7ac-dbb42a191420 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:53.043119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-098fa6d8-4667-4663-b7ac-dbb42a191420 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:53.043542 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-098fa6d8-4667-4663-b7ac-dbb42a191420 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:53.184783 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-098fa6d8-4667-4663-b7ac-dbb42a191420 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:53.193094 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-098fa6d8-4667-4663-b7ac-dbb42a191420 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.163584 Sep 19 17:26:53.193666 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 231/465] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:53 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:54.215400 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d8999516-287f-4992-86d4-bd71ce260d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:54.216337 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d8999516-287f-4992-86d4-bd71ce260d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:54.222628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8999516-287f-4992-86d4-bd71ce260d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:54.223114 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8999516-287f-4992-86d4-bd71ce260d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:54.223554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8999516-287f-4992-86d4-bd71ce260d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:54.224276 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8999516-287f-4992-86d4-bd71ce260d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:54.224768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8999516-287f-4992-86d4-bd71ce260d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:54.225196 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8999516-287f-4992-86d4-bd71ce260d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:54.362766 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d8999516-287f-4992-86d4-bd71ce260d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:54.378085 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d8999516-287f-4992-86d4-bd71ce260d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.166589 Sep 19 17:26:54.378679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 235/466] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:54 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:55.402285 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-79b89004-3b84-4ba1-9156-c47998a4805f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:55.402890 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-79b89004-3b84-4ba1-9156-c47998a4805f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:55.405217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=30 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:55.409885 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b89004-3b84-4ba1-9156-c47998a4805f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:55.410373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b89004-3b84-4ba1-9156-c47998a4805f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:55.410844 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b89004-3b84-4ba1-9156-c47998a4805f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:55.411544 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b89004-3b84-4ba1-9156-c47998a4805f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:55.412024 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b89004-3b84-4ba1-9156-c47998a4805f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:55.412450 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b89004-3b84-4ba1-9156-c47998a4805f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:55.540717 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-79b89004-3b84-4ba1-9156-c47998a4805f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:55.550240 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-79b89004-3b84-4ba1-9156-c47998a4805f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.151846 Sep 19 17:26:55.550814 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 232/467] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:55 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:56.574119 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36a9014a-9d5c-40a0-bb2d-ec91d3c58c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:56.575322 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-36a9014a-9d5c-40a0-bb2d-ec91d3c58c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:56.581734 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36a9014a-9d5c-40a0-bb2d-ec91d3c58c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:56.582213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36a9014a-9d5c-40a0-bb2d-ec91d3c58c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:56.582649 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36a9014a-9d5c-40a0-bb2d-ec91d3c58c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:56.583332 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36a9014a-9d5c-40a0-bb2d-ec91d3c58c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:56.583811 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36a9014a-9d5c-40a0-bb2d-ec91d3c58c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:56.584232 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36a9014a-9d5c-40a0-bb2d-ec91d3c58c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:56.713021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-36a9014a-9d5c-40a0-bb2d-ec91d3c58c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:56.721003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36a9014a-9d5c-40a0-bb2d-ec91d3c58c4f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.150854 Sep 19 17:26:56.721572 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 236/468] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:56 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:57.743826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b3680ec3-bb8c-4eab-8540-60d9898595b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:57.744441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b3680ec3-bb8c-4eab-8540-60d9898595b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:57.750786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3680ec3-bb8c-4eab-8540-60d9898595b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:57.751270 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3680ec3-bb8c-4eab-8540-60d9898595b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:57.751733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3680ec3-bb8c-4eab-8540-60d9898595b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:57.752428 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3680ec3-bb8c-4eab-8540-60d9898595b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:57.752908 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3680ec3-bb8c-4eab-8540-60d9898595b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:57.753332 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3680ec3-bb8c-4eab-8540-60d9898595b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:57.755829 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:26:57.881349 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b3680ec3-bb8c-4eab-8540-60d9898595b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:57.888826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b3680ec3-bb8c-4eab-8540-60d9898595b7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.148823 Sep 19 17:26:57.889392 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 233/469] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:57 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:26:58.913914 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b03e589d-ac86-4365-84f6-c2af44491c21 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:26:58.914456 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b03e589d-ac86-4365-84f6-c2af44491c21 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:26:58.921001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b03e589d-ac86-4365-84f6-c2af44491c21 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:58.922121 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b03e589d-ac86-4365-84f6-c2af44491c21 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:58.922618 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b03e589d-ac86-4365-84f6-c2af44491c21 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:58.923312 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b03e589d-ac86-4365-84f6-c2af44491c21 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:26:58.923865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b03e589d-ac86-4365-84f6-c2af44491c21 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:26:58.924295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b03e589d-ac86-4365-84f6-c2af44491c21 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:26:59.062507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b03e589d-ac86-4365-84f6-c2af44491c21 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:26:59.070406 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b03e589d-ac86-4365-84f6-c2af44491c21 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.160442 Sep 19 17:26:59.071177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 237/470] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:26:58 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:00.092931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bfddd48d-bab1-47be-81c3-5adcc2da8d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:00.093542 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bfddd48d-bab1-47be-81c3-5adcc2da8d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:00.100641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfddd48d-bab1-47be-81c3-5adcc2da8d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:00.101124 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfddd48d-bab1-47be-81c3-5adcc2da8d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:00.101562 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfddd48d-bab1-47be-81c3-5adcc2da8d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:00.102260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfddd48d-bab1-47be-81c3-5adcc2da8d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:00.102717 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfddd48d-bab1-47be-81c3-5adcc2da8d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:00.103143 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfddd48d-bab1-47be-81c3-5adcc2da8d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:00.232733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bfddd48d-bab1-47be-81c3-5adcc2da8d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:00.240960 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bfddd48d-bab1-47be-81c3-5adcc2da8d3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.151874 Sep 19 17:27:00.241591 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 234/471] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:00 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:01.263153 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09f5215a-3d78-4d10-a889-1eeb309b8b45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:01.263727 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09f5215a-3d78-4d10-a889-1eeb309b8b45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:01.271286 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f5215a-3d78-4d10-a889-1eeb309b8b45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:01.271804 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f5215a-3d78-4d10-a889-1eeb309b8b45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:01.272242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f5215a-3d78-4d10-a889-1eeb309b8b45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:01.272931 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f5215a-3d78-4d10-a889-1eeb309b8b45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:01.273389 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f5215a-3d78-4d10-a889-1eeb309b8b45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:01.273812 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f5215a-3d78-4d10-a889-1eeb309b8b45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:01.399408 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-09f5215a-3d78-4d10-a889-1eeb309b8b45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:01.407146 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09f5215a-3d78-4d10-a889-1eeb309b8b45 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.147986 Sep 19 17:27:01.407787 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 238/472] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:01 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:02.430970 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af04a20f-0f45-4c34-8588-7b1007fa0af9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:02.431581 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-af04a20f-0f45-4c34-8588-7b1007fa0af9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:02.438451 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af04a20f-0f45-4c34-8588-7b1007fa0af9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:02.438932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af04a20f-0f45-4c34-8588-7b1007fa0af9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:02.439373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af04a20f-0f45-4c34-8588-7b1007fa0af9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:02.440101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af04a20f-0f45-4c34-8588-7b1007fa0af9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:02.440616 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af04a20f-0f45-4c34-8588-7b1007fa0af9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:02.441044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af04a20f-0f45-4c34-8588-7b1007fa0af9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:02.569839 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-af04a20f-0f45-4c34-8588-7b1007fa0af9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:02.578401 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-af04a20f-0f45-4c34-8588-7b1007fa0af9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.150887 Sep 19 17:27:02.578960 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 235/473] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:02 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:03.601259 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1afd5271-a4c9-43b1-9b66-b404681c29ec tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:03.601873 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1afd5271-a4c9-43b1-9b66-b404681c29ec tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:03.608430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afd5271-a4c9-43b1-9b66-b404681c29ec tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:03.608919 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afd5271-a4c9-43b1-9b66-b404681c29ec tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:03.609361 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afd5271-a4c9-43b1-9b66-b404681c29ec tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:03.610061 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afd5271-a4c9-43b1-9b66-b404681c29ec tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:03.610515 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afd5271-a4c9-43b1-9b66-b404681c29ec tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:03.610942 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afd5271-a4c9-43b1-9b66-b404681c29ec tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:03.739563 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1afd5271-a4c9-43b1-9b66-b404681c29ec tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:03.747179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1afd5271-a4c9-43b1-9b66-b404681c29ec tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.149918 Sep 19 17:27:03.747774 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 239/474] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:03 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:04.211050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f8dfb840-cfb7-4928-b11a-606c1cc70e72 req-3eacff79-6099-4fd3-95c3-d3be79539d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2632c0f-04a3-4b90-b4b1-f8989649a34a", "name": "network-vif-plugged", "status": "completed", "tag": "8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:27:04.221226 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f8dfb840-cfb7-4928-b11a-606c1cc70e72 req-3eacff79-6099-4fd3-95c3-d3be79539d86 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:04.221714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f8dfb840-cfb7-4928-b11a-606c1cc70e72 req-3eacff79-6099-4fd3-95c3-d3be79539d86 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:04.222149 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f8dfb840-cfb7-4928-b11a-606c1cc70e72 req-3eacff79-6099-4fd3-95c3-d3be79539d86 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:04.232883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f8dfb840-cfb7-4928-b11a-606c1cc70e72 req-3eacff79-6099-4fd3-95c3-d3be79539d86 service nova] Creating event network-vif-plugged:8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0 for instance f2632c0f-04a3-4b90-b4b1-f8989649a34a on hv-cinder-84801 Sep 19 17:27:04.238251 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f8dfb840-cfb7-4928-b11a-606c1cc70e72 req-3eacff79-6099-4fd3-95c3-d3be79539d86 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031182 Sep 19 17:27:04.238925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 236/475] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:27:04.772698 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0afe6b23-5f98-4f17-b5aa-39b5e2d752f3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:04.773667 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0afe6b23-5f98-4f17-b5aa-39b5e2d752f3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:04.780286 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0afe6b23-5f98-4f17-b5aa-39b5e2d752f3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:04.781457 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0afe6b23-5f98-4f17-b5aa-39b5e2d752f3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:04.782538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0afe6b23-5f98-4f17-b5aa-39b5e2d752f3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:04.783108 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0afe6b23-5f98-4f17-b5aa-39b5e2d752f3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:04.783331 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0afe6b23-5f98-4f17-b5aa-39b5e2d752f3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:04.784059 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0afe6b23-5f98-4f17-b5aa-39b5e2d752f3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:04.917381 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0afe6b23-5f98-4f17-b5aa-39b5e2d752f3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:04.925616 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0afe6b23-5f98-4f17-b5aa-39b5e2d752f3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.158827 Sep 19 17:27:04.926182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 240/476] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:04 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:05.949780 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f97f397-dc24-4c38-9783-226fef43ff99 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:05.950563 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0f97f397-dc24-4c38-9783-226fef43ff99 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:05.958621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f97f397-dc24-4c38-9783-226fef43ff99 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:05.959230 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f97f397-dc24-4c38-9783-226fef43ff99 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:05.959539 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f97f397-dc24-4c38-9783-226fef43ff99 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:05.960269 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f97f397-dc24-4c38-9783-226fef43ff99 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:05.962794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f97f397-dc24-4c38-9783-226fef43ff99 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:05.962794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f97f397-dc24-4c38-9783-226fef43ff99 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:06.102551 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0f97f397-dc24-4c38-9783-226fef43ff99 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:06.110383 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f97f397-dc24-4c38-9783-226fef43ff99 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.165378 Sep 19 17:27:06.110949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 237/477] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:05 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:07.134296 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca3d1a6f-a2f7-4c3b-a179-1954705a4b0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:07.134896 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca3d1a6f-a2f7-4c3b-a179-1954705a4b0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:07.141457 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3d1a6f-a2f7-4c3b-a179-1954705a4b0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:07.141950 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3d1a6f-a2f7-4c3b-a179-1954705a4b0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:07.142386 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3d1a6f-a2f7-4c3b-a179-1954705a4b0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:07.143333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3d1a6f-a2f7-4c3b-a179-1954705a4b0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:07.143826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3d1a6f-a2f7-4c3b-a179-1954705a4b0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:07.144251 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3d1a6f-a2f7-4c3b-a179-1954705a4b0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:07.279822 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca3d1a6f-a2f7-4c3b-a179-1954705a4b0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:07.288347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca3d1a6f-a2f7-4c3b-a179-1954705a4b0b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1371 microversion: 2.1 time: 0.158868 Sep 19 17:27:07.288915 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 241/478] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:07 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:27:08.313741 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f4b6652-fd54-4ddd-93cd-5abd6a57ca33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:08.317929 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0f4b6652-fd54-4ddd-93cd-5abd6a57ca33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:08.320454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4b6652-fd54-4ddd-93cd-5abd6a57ca33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:08.320943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4b6652-fd54-4ddd-93cd-5abd6a57ca33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:08.321373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4b6652-fd54-4ddd-93cd-5abd6a57ca33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:08.322063 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4b6652-fd54-4ddd-93cd-5abd6a57ca33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:08.322899 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4b6652-fd54-4ddd-93cd-5abd6a57ca33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:08.323384 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4b6652-fd54-4ddd-93cd-5abd6a57ca33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:08.470337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0f4b6652-fd54-4ddd-93cd-5abd6a57ca33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:08.478430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f4b6652-fd54-4ddd-93cd-5abd6a57ca33 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1566 microversion: 2.1 time: 0.169133 Sep 19 17:27:08.479089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 238/479] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:08 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:08.501356 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-35f1d9e1-62c2-4d19-a3d9-193a8ee893da tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:08.501920 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-35f1d9e1-62c2-4d19-a3d9-193a8ee893da tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:08.504140 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:08.508743 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35f1d9e1-62c2-4d19-a3d9-193a8ee893da tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:08.509222 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35f1d9e1-62c2-4d19-a3d9-193a8ee893da tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:08.509655 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35f1d9e1-62c2-4d19-a3d9-193a8ee893da tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:08.510337 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35f1d9e1-62c2-4d19-a3d9-193a8ee893da tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:08.510851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35f1d9e1-62c2-4d19-a3d9-193a8ee893da tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:08.511319 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35f1d9e1-62c2-4d19-a3d9-193a8ee893da tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:08.513653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=82 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:08.590305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-35f1d9e1-62c2-4d19-a3d9-193a8ee893da tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093403 Sep 19 17:27:08.590918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 242/480] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Sep 19 17:27:08 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:27:08.716517 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0ab35e4-65dc-43de-af2f-e35997d0e62a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:08.717103 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c0ab35e4-65dc-43de-af2f-e35997d0e62a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:08.723530 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ab35e4-65dc-43de-af2f-e35997d0e62a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:08.724223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ab35e4-65dc-43de-af2f-e35997d0e62a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:08.724740 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ab35e4-65dc-43de-af2f-e35997d0e62a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:08.725525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ab35e4-65dc-43de-af2f-e35997d0e62a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:08.726057 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ab35e4-65dc-43de-af2f-e35997d0e62a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:08.726564 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ab35e4-65dc-43de-af2f-e35997d0e62a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:08.859857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c0ab35e4-65dc-43de-af2f-e35997d0e62a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lazy-loading 'services' on Instance uuid 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:27:09.106132 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c0ab35e4-65dc-43de-af2f-e35997d0e62a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832/os-volume_attachments/2b4ff649-3006-47b4-ab15-a781ae590b11" status: 202 len: 0 microversion: 2.1 time: 0.393374 Sep 19 17:27:09.106813 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 239/481] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:27:08 2022] DELETE /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832/os-volume_attachments/2b4ff649-3006-47b4-ab15-a781ae590b11 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:27:09.939399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6ec0334e-b277-4b9d-9047-45d9de7a0e49 req-79f53af6-6b97-4665-97aa-4452b191ae7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2632c0f-04a3-4b90-b4b1-f8989649a34a", "tag": "8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:27:09.950537 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6ec0334e-b277-4b9d-9047-45d9de7a0e49 req-79f53af6-6b97-4665-97aa-4452b191ae7b service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:09.951195 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6ec0334e-b277-4b9d-9047-45d9de7a0e49 req-79f53af6-6b97-4665-97aa-4452b191ae7b service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:09.951859 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6ec0334e-b277-4b9d-9047-45d9de7a0e49 req-79f53af6-6b97-4665-97aa-4452b191ae7b service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:09.964784 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6ec0334e-b277-4b9d-9047-45d9de7a0e49 req-79f53af6-6b97-4665-97aa-4452b191ae7b service nova] Creating event network-changed:8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0 for instance f2632c0f-04a3-4b90-b4b1-f8989649a34a on hv-cinder-84801 Sep 19 17:27:09.970231 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6ec0334e-b277-4b9d-9047-45d9de7a0e49 req-79f53af6-6b97-4665-97aa-4452b191ae7b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036566 Sep 19 17:27:09.970904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 243/482] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:27:11.324961 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4e248e17-95a0-49ee-83c8-87a7f58e929e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:11.329169 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4e248e17-95a0-49ee-83c8-87a7f58e929e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:11.333788 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e248e17-95a0-49ee-83c8-87a7f58e929e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:11.334388 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e248e17-95a0-49ee-83c8-87a7f58e929e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:11.334834 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e248e17-95a0-49ee-83c8-87a7f58e929e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:11.335545 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e248e17-95a0-49ee-83c8-87a7f58e929e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:11.336114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e248e17-95a0-49ee-83c8-87a7f58e929e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:11.336547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e248e17-95a0-49ee-83c8-87a7f58e929e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:11.365953 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4e248e17-95a0-49ee-83c8-87a7f58e929e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:27:11.724247 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4e248e17-95a0-49ee-83c8-87a7f58e929e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 204 len: 0 microversion: 2.1 time: 0.404614 Sep 19 17:27:11.724856 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 240/483] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:27:11 2022] DELETE /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:27:11.734668 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-94615c80-2403-4b2e-9f37-e679c3fbf200 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:11.735504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-94615c80-2403-4b2e-9f37-e679c3fbf200 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:11.741904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94615c80-2403-4b2e-9f37-e679c3fbf200 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:11.742385 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94615c80-2403-4b2e-9f37-e679c3fbf200 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:11.742827 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94615c80-2403-4b2e-9f37-e679c3fbf200 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:11.743519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94615c80-2403-4b2e-9f37-e679c3fbf200 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:11.744025 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94615c80-2403-4b2e-9f37-e679c3fbf200 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:11.744538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94615c80-2403-4b2e-9f37-e679c3fbf200 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:11.948768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-94615c80-2403-4b2e-9f37-e679c3fbf200 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:11.962050 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-94615c80-2403-4b2e-9f37-e679c3fbf200 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1511 microversion: 2.1 time: 0.229367 Sep 19 17:27:11.962050 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 244/484] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:11 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1511 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:12.984604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb7f9bbb-0259-4f58-9a09-3a2e1c1ff60e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:12.986132 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fb7f9bbb-0259-4f58-9a09-3a2e1c1ff60e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:12.992478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb7f9bbb-0259-4f58-9a09-3a2e1c1ff60e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:12.992977 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb7f9bbb-0259-4f58-9a09-3a2e1c1ff60e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:12.994673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb7f9bbb-0259-4f58-9a09-3a2e1c1ff60e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:12.994673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb7f9bbb-0259-4f58-9a09-3a2e1c1ff60e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:12.995042 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb7f9bbb-0259-4f58-9a09-3a2e1c1ff60e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:12.995814 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb7f9bbb-0259-4f58-9a09-3a2e1c1ff60e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:13.251278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fb7f9bbb-0259-4f58-9a09-3a2e1c1ff60e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:13.260252 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb7f9bbb-0259-4f58-9a09-3a2e1c1ff60e tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1511 microversion: 2.1 time: 0.279943 Sep 19 17:27:13.261042 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 241/485] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:12 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:27:14.285477 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a640c41-49e3-4c60-9fc2-c2a04e9176f3 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:14.286958 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a640c41-49e3-4c60-9fc2-c2a04e9176f3 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:14.294205 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a640c41-49e3-4c60-9fc2-c2a04e9176f3 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:14.302698 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a640c41-49e3-4c60-9fc2-c2a04e9176f3 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:14.303493 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a640c41-49e3-4c60-9fc2-c2a04e9176f3 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:14.305017 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a640c41-49e3-4c60-9fc2-c2a04e9176f3 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:14.305889 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a640c41-49e3-4c60-9fc2-c2a04e9176f3 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:14.306551 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a640c41-49e3-4c60-9fc2-c2a04e9176f3 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:14.535153 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a640c41-49e3-4c60-9fc2-c2a04e9176f3 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:14.546078 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a640c41-49e3-4c60-9fc2-c2a04e9176f3 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1511 microversion: 2.1 time: 0.265127 Sep 19 17:27:14.546794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 245/486] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:14 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:14.864284 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-d9e05847-8e90-4e04-8a67-885564865348 req-713687ab-389d-46f9-bdb5-afd633328bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a4c48df-be43-44ba-9cdb-0ef1fd8f1832", "name": "network-vif-deleted", "tag": "bcbdade5-91b0-478b-a2b9-d91a169e51b2"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:27:14.876792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d9e05847-8e90-4e04-8a67-885564865348 req-713687ab-389d-46f9-bdb5-afd633328bd1 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:14.876792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d9e05847-8e90-4e04-8a67-885564865348 req-713687ab-389d-46f9-bdb5-afd633328bd1 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:14.876792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d9e05847-8e90-4e04-8a67-885564865348 req-713687ab-389d-46f9-bdb5-afd633328bd1 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:14.888411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-d9e05847-8e90-4e04-8a67-885564865348 req-713687ab-389d-46f9-bdb5-afd633328bd1 service nova] Creating event network-vif-deleted:bcbdade5-91b0-478b-a2b9-d91a169e51b2 for instance 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 on hv-cinder-84801 Sep 19 17:27:14.894569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-d9e05847-8e90-4e04-8a67-885564865348 req-713687ab-389d-46f9-bdb5-afd633328bd1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033812 Sep 19 17:27:14.895181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 242/487] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:27:15.569163 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:15.573066 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:15.575965 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:15.576567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:15.577012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:15.578390 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:15.578846 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:15.579269 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:15.612254 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:15.613251 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:15.613364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:15.613827 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lazy-loading 'fault' on Instance uuid 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:27:15.695190 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:15.704601 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21f597cd-f775-4be2-82f4-dc430ffd20f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 200 len: 1308 microversion: 2.1 time: 0.139037 Sep 19 17:27:15.705591 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 246/488] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:15 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 1308 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:16.732459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:16.734695 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:16.741930 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:16.742424 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:16.742854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:16.743718 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:16.744187 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:16.744612 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:16.759359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] HTTP exception thrown: Instance 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 could not be found. Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Request method failure captured: Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 HTTP/1.1 Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKXl4mS5escdT69lsiyURoJPLhJfAFDIyiUXOUKexr2h48t_7I-726hxAn9DrDCjf2dstZso9y-CdBKPIaFFgNcNhN1I1mZZ1jBn4oUA3fiLKqbaBJxq5czFBskJ33YTE_aVBXDEAB4IfV7rvwH6jf7XDYfs2Xtx-IUcqctgH_lJJPg Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 6198c6cbed294d0eb4ef8fcd97ba96fe Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesSnapshotTestJSON-405652299 Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:27:16.761189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6198c6cbed294d0eb4ef8fcd97ba96fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6198c6cbed294d0eb4ef8fcd97ba96fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6198c6cbed294d0eb4ef8fcd97ba96fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6198c6cbed294d0eb4ef8fcd97ba96fe"}]}] Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-VolumesSnapshotTestJSON-405652299 Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 6198c6cbed294d0eb4ef8fcd97ba96fe Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-405652299 Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-VolumesSnapshotTestJSON-405652299-project Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 74a2c7317c61405e8c9e9118286be69d Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-VolumesSnapshotTestJSON-405652299-project Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 could not be found. Sep 19 17:27:16.763604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '3a4c48df-be43-44ba-9cdb-0ef1fd8f1832'} Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 could not be found. Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:27:16.764366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 could not be found. Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 could not be found. Sep 19 17:27:16.765600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:27:16.766660 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Returning 404 to user: Instance 3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:27:16.766660 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b96ac8a1-3f54-433a-9e18-314038ace09b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832" status: 404 len: 111 microversion: 2.1 time: 0.036795 Sep 19 17:27:16.766660 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 243/489] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:16 2022] GET /compute/v2.1/servers/3a4c48df-be43-44ba-9cdb-0ef1fd8f1832 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:27:23.367153 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c21eba85-563e-4780-9e2d-b71c163a1dba tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Action: 'create', calling method: .version_select at 0x7fd4d6011ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-564527321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2gL1Ph7LFY4kg0+r06tXimPwsMnFOVFc+7NxHRUMMq0YzWg/T9KciO0ZQ2Yb0aIlH8LdunUuuXILLLvptRRDEuMvize4QjDxGkok7XrqzBv9mjo+zwsr/bhZsC7njBqg=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:27:23.383222 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-c21eba85-563e-4780-9e2d-b71c163a1dba tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Getting quotas for project 4ff66ee28420498aa3f3ac65946c8bca. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:27:23.387228 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-c21eba85-563e-4780-9e2d-b71c163a1dba tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Getting quotas for user 038341fa1ec446e080145a30f1911a3b and project 4ff66ee28420498aa3f3ac65946c8bca. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:27:23.491875 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c21eba85-563e-4780-9e2d-b71c163a1dba tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.317408 Sep 19 17:27:23.492486 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 247/490] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Sep 19 17:27:23 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:27:29.514584 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-969805666", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "networks": [{"uuid": "7d1d32ac-68b4-4010-b266-e123719339b9"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:27:29.524751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:29.525543 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:29.572083 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] validate_networks() for [('7d1d32ac-68b4-4010-b266-e123719339b9', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:27:29.931871 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:27:29.932299 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:27:29.932982 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:27:29.933324 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:27:29.933662 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:27:29.943673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:29.944214 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:29.944657 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:29.945589 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:29.945903 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:29.946334 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:29.963258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Getting quotas for project 6198c6cbed294d0eb4ef8fcd97ba96fe. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:27:29.967204 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Getting quotas for user 74a2c7317c61405e8c9e9118286be69d and project 6198c6cbed294d0eb4ef8fcd97ba96fe. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:27:29.979274 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:27:29.981661 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:27:30.150122 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f632cfb9-1519-4009-ac13-b844e44bdbfd tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639353 Sep 19 17:27:30.150770 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 244/491] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:27:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:27:30.160237 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=25 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:30.164386 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47317811-f446-449d-8939-ec565b70b5f5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:30.165003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47317811-f446-449d-8939-ec565b70b5f5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:30.220773 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-47317811-f446-449d-8939-ec565b70b5f5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:30.228823 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47317811-f446-449d-8939-ec565b70b5f5 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1218 microversion: 2.1 time: 0.070103 Sep 19 17:27:30.229395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 248/492] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:30 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:31.251767 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4405ab2e-0726-4935-86cb-f8216e3a6fb0 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:31.252473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4405ab2e-0726-4935-86cb-f8216e3a6fb0 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:31.310314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4405ab2e-0726-4935-86cb-f8216e3a6fb0 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:31.317283 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4405ab2e-0726-4935-86cb-f8216e3a6fb0 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1218 microversion: 2.1 time: 0.070209 Sep 19 17:27:31.317918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 245/493] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:31 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:32.340670 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c6375ef-2b9c-4e24-9e14-a731230c3d50 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:32.341295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6c6375ef-2b9c-4e24-9e14-a731230c3d50 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:32.399714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6c6375ef-2b9c-4e24-9e14-a731230c3d50 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:32.407392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6c6375ef-2b9c-4e24-9e14-a731230c3d50 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1218 microversion: 2.1 time: 0.071088 Sep 19 17:27:32.408007 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 249/494] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:32 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:33.430750 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-438f7d6e-61c0-48b0-97e9-4be4a5e09715 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:33.431369 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-438f7d6e-61c0-48b0-97e9-4be4a5e09715 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:33.484474 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-438f7d6e-61c0-48b0-97e9-4be4a5e09715 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:33.491454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-438f7d6e-61c0-48b0-97e9-4be4a5e09715 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1218 microversion: 2.1 time: 0.064697 Sep 19 17:27:33.492994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 246/495] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:33 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:34.246588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-50adb57c-91d1-4425-8b61-dd33be0c5807 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:34.247117 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-50adb57c-91d1-4425-8b61-dd33be0c5807 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:34.254620 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50adb57c-91d1-4425-8b61-dd33be0c5807 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:34.255111 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50adb57c-91d1-4425-8b61-dd33be0c5807 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:34.255552 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50adb57c-91d1-4425-8b61-dd33be0c5807 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:34.256298 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50adb57c-91d1-4425-8b61-dd33be0c5807 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:34.256759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50adb57c-91d1-4425-8b61-dd33be0c5807 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:34.257189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50adb57c-91d1-4425-8b61-dd33be0c5807 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:34.284198 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-50adb57c-91d1-4425-8b61-dd33be0c5807 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/ips" status: 200 len: 151 microversion: 2.20 time: 0.041635 Sep 19 17:27:34.284777 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 250/496] 10.222.0.61 () {60 vars in 1289 bytes} [Mon Sep 19 17:27:34 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:27:34.514674 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-957d0c65-115e-4ea2-a5ad-0f8c45773da1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:34.515353 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-957d0c65-115e-4ea2-a5ad-0f8c45773da1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:34.523676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957d0c65-115e-4ea2-a5ad-0f8c45773da1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:34.524214 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957d0c65-115e-4ea2-a5ad-0f8c45773da1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:34.524632 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957d0c65-115e-4ea2-a5ad-0f8c45773da1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:34.525373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957d0c65-115e-4ea2-a5ad-0f8c45773da1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:34.525832 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957d0c65-115e-4ea2-a5ad-0f8c45773da1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:34.526272 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957d0c65-115e-4ea2-a5ad-0f8c45773da1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:34.595024 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-957d0c65-115e-4ea2-a5ad-0f8c45773da1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:34.603209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-957d0c65-115e-4ea2-a5ad-0f8c45773da1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1222 microversion: 2.1 time: 0.092408 Sep 19 17:27:34.603856 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 247/497] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:34 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:35.627070 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f9985219-0bec-41fd-a71f-49099fb862d7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:35.627684 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f9985219-0bec-41fd-a71f-49099fb862d7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:35.634643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9985219-0bec-41fd-a71f-49099fb862d7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:35.635176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9985219-0bec-41fd-a71f-49099fb862d7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:35.635613 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9985219-0bec-41fd-a71f-49099fb862d7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:35.636464 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9985219-0bec-41fd-a71f-49099fb862d7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:35.636917 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9985219-0bec-41fd-a71f-49099fb862d7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:35.637345 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9985219-0bec-41fd-a71f-49099fb862d7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:35.705368 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f9985219-0bec-41fd-a71f-49099fb862d7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:35.713469 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f9985219-0bec-41fd-a71f-49099fb862d7 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1270 microversion: 2.1 time: 0.090582 Sep 19 17:27:35.714031 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 251/498] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:35 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:36.736818 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8c465f3a-b26f-4e36-be20-78bb9b619d05 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:36.737439 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8c465f3a-b26f-4e36-be20-78bb9b619d05 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:36.743366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c465f3a-b26f-4e36-be20-78bb9b619d05 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:36.743889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c465f3a-b26f-4e36-be20-78bb9b619d05 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:36.744329 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c465f3a-b26f-4e36-be20-78bb9b619d05 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:36.745035 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c465f3a-b26f-4e36-be20-78bb9b619d05 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:36.745493 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c465f3a-b26f-4e36-be20-78bb9b619d05 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:36.747603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c465f3a-b26f-4e36-be20-78bb9b619d05 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:36.811674 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8c465f3a-b26f-4e36-be20-78bb9b619d05 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:36.820085 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8c465f3a-b26f-4e36-be20-78bb9b619d05 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1288 microversion: 2.1 time: 0.087623 Sep 19 17:27:36.820666 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 248/499] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:36 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:37.696263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca4723c6-3931-43eb-a472-428d7c213799 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:27:37.696928 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca4723c6-3931-43eb-a472-428d7c213799 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:37.704223 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca4723c6-3931-43eb-a472-428d7c213799 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:37.704823 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca4723c6-3931-43eb-a472-428d7c213799 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:37.705369 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca4723c6-3931-43eb-a472-428d7c213799 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:37.706085 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca4723c6-3931-43eb-a472-428d7c213799 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:37.706539 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca4723c6-3931-43eb-a472-428d7c213799 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:37.706970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca4723c6-3931-43eb-a472-428d7c213799 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:37.732823 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-ca4723c6-3931-43eb-a472-428d7c213799 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lazy-loading 'flavor' on Instance uuid 8d2eb485-3b5a-4326-bd4f-9029da4e6744 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:27:37.843062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7ecbb738-493d-49e2-bef5-17708d639729 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:37.844088 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7ecbb738-493d-49e2-bef5-17708d639729 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:37.851392 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ecbb738-493d-49e2-bef5-17708d639729 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:37.852001 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ecbb738-493d-49e2-bef5-17708d639729 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:37.852717 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ecbb738-493d-49e2-bef5-17708d639729 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:37.853571 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ecbb738-493d-49e2-bef5-17708d639729 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:37.854100 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ecbb738-493d-49e2-bef5-17708d639729 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:37.854599 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ecbb738-493d-49e2-bef5-17708d639729 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:38.006973 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ecbb738-493d-49e2-bef5-17708d639729 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:38.016481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7ecbb738-493d-49e2-bef5-17708d639729 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.176832 Sep 19 17:27:38.016997 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 249/500] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:37 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:38.292617 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca4723c6-3931-43eb-a472-428d7c213799 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "POST /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/action" status: 202 len: 0 microversion: 2.20 time: 0.600261 Sep 19 17:27:38.293332 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 252/501] 10.222.0.61 () {62 vars in 1319 bytes} [Mon Sep 19 17:27:37 2022] POST /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 17:27:38.302233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:38.308242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:38.308998 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:38.309479 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:38.309912 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:38.310604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:38.311050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:38.311470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:38.457560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:38.463599 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:38.465176 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:38.465647 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-102b433b-5ec1-4863-b896-b85c8f898bd9 req-ff6674dc-e588-4bb7-b498-a91ece81013e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32db63e3-5981-4b3d-b998-d41a91dd16db", "tag": "ac32b4b1-2aff-4e55-922e-d6e0023c5354"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:27:38.466725 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-30489b73-282d-4da1-9fe8-1e3ff23cea6e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.168327 Sep 19 17:27:38.467548 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 250/502] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:38 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:38.491687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-102b433b-5ec1-4863-b896-b85c8f898bd9 req-ff6674dc-e588-4bb7-b498-a91ece81013e service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:38.491687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-102b433b-5ec1-4863-b896-b85c8f898bd9 req-ff6674dc-e588-4bb7-b498-a91ece81013e service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:38.491687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-102b433b-5ec1-4863-b896-b85c8f898bd9 req-ff6674dc-e588-4bb7-b498-a91ece81013e service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:38.499035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-102b433b-5ec1-4863-b896-b85c8f898bd9 req-ff6674dc-e588-4bb7-b498-a91ece81013e service nova] Creating event network-changed:ac32b4b1-2aff-4e55-922e-d6e0023c5354 for instance 32db63e3-5981-4b3d-b998-d41a91dd16db on hv-cinder-84801 Sep 19 17:27:38.503907 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-102b433b-5ec1-4863-b896-b85c8f898bd9 req-ff6674dc-e588-4bb7-b498-a91ece81013e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050064 Sep 19 17:27:38.504546 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 253/503] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:27:39.043187 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-724a2efd-2924-410b-95f9-406ce634b92c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:39.043187 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-724a2efd-2924-410b-95f9-406ce634b92c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:39.047543 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724a2efd-2924-410b-95f9-406ce634b92c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:39.048070 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724a2efd-2924-410b-95f9-406ce634b92c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:39.048523 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724a2efd-2924-410b-95f9-406ce634b92c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:39.049225 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724a2efd-2924-410b-95f9-406ce634b92c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:39.049691 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724a2efd-2924-410b-95f9-406ce634b92c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:39.050144 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724a2efd-2924-410b-95f9-406ce634b92c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:39.192778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-724a2efd-2924-410b-95f9-406ce634b92c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:39.200873 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-724a2efd-2924-410b-95f9-406ce634b92c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.164543 Sep 19 17:27:39.201846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 251/504] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:39 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:39.496732 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:39.497433 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:39.503611 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:39.504139 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:39.504576 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:39.505295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:39.505751 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:39.506176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:39.649847 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:39.660757 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:39.662204 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:39.663374 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-97555177-4827-4556-8a3b-d9b29a9eba58 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.171522 Sep 19 17:27:39.663968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 254/505] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:39 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:40.224062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-344b70f4-bb38-4085-95bb-e226e3d9e2e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:40.224674 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-344b70f4-bb38-4085-95bb-e226e3d9e2e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:40.226916 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:40.233231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-344b70f4-bb38-4085-95bb-e226e3d9e2e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:40.233639 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-344b70f4-bb38-4085-95bb-e226e3d9e2e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:40.234099 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-344b70f4-bb38-4085-95bb-e226e3d9e2e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:40.234799 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-344b70f4-bb38-4085-95bb-e226e3d9e2e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:40.235246 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-344b70f4-bb38-4085-95bb-e226e3d9e2e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:40.236200 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-344b70f4-bb38-4085-95bb-e226e3d9e2e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:40.371269 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-344b70f4-bb38-4085-95bb-e226e3d9e2e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:40.379542 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-344b70f4-bb38-4085-95bb-e226e3d9e2e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.159555 Sep 19 17:27:40.380132 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 252/506] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:40 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:40.690032 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:40.690632 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:40.693017 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:40.697818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:40.698290 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:40.698768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:40.699448 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:40.699921 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:40.704860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:40.827297 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:40.835959 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:40.837403 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:40.838559 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f9bc5d5e-ca32-477a-8c11-a0f85648199d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.152894 Sep 19 17:27:40.839127 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 255/507] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:40 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:41.402153 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-20473df1-bff9-4587-88f4-6d04a424c7ce tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:41.402772 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-20473df1-bff9-4587-88f4-6d04a424c7ce tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:41.409633 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20473df1-bff9-4587-88f4-6d04a424c7ce tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:41.410115 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20473df1-bff9-4587-88f4-6d04a424c7ce tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:41.410557 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20473df1-bff9-4587-88f4-6d04a424c7ce tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:41.411250 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20473df1-bff9-4587-88f4-6d04a424c7ce tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:41.411746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20473df1-bff9-4587-88f4-6d04a424c7ce tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:41.412184 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20473df1-bff9-4587-88f4-6d04a424c7ce tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:41.541661 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-20473df1-bff9-4587-88f4-6d04a424c7ce tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:41.549773 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-20473df1-bff9-4587-88f4-6d04a424c7ce tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.151486 Sep 19 17:27:41.550365 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 253/508] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:41 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:41.864185 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:41.864909 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:41.871277 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:41.871814 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:41.872255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:41.872945 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:41.873403 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:41.873824 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:42.002706 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:42.011094 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:42.012596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:42.013769 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-352857e9-1832-4256-8bb3-af7ae11d9785 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.153961 Sep 19 17:27:42.014367 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 256/509] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:41 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:42.572463 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ce5d60f8-6190-4de5-bdbd-69e9d60a1a91 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:42.573045 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ce5d60f8-6190-4de5-bdbd-69e9d60a1a91 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:42.579301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5d60f8-6190-4de5-bdbd-69e9d60a1a91 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:42.579891 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5d60f8-6190-4de5-bdbd-69e9d60a1a91 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:42.580335 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5d60f8-6190-4de5-bdbd-69e9d60a1a91 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:42.581032 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5d60f8-6190-4de5-bdbd-69e9d60a1a91 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:42.581492 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5d60f8-6190-4de5-bdbd-69e9d60a1a91 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:42.581923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5d60f8-6190-4de5-bdbd-69e9d60a1a91 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:42.709891 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ce5d60f8-6190-4de5-bdbd-69e9d60a1a91 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:42.717307 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ce5d60f8-6190-4de5-bdbd-69e9d60a1a91 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.148885 Sep 19 17:27:42.717871 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 254/510] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:42 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:43.039314 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:43.039977 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:43.041906 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:43.047199 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:43.047797 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:43.048988 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:43.049729 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:43.050195 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:43.050660 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:43.182478 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:43.191239 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:43.192718 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:43.193887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed8cda64-6491-4cf1-9f17-fdfe53028613 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.158644 Sep 19 17:27:43.194451 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 257/511] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:43 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:27:43.739598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c401c07-7d47-42b2-9a68-7bc5a6441292 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:43.740244 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c401c07-7d47-42b2-9a68-7bc5a6441292 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:43.742057 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:43.747880 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c401c07-7d47-42b2-9a68-7bc5a6441292 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:43.748374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c401c07-7d47-42b2-9a68-7bc5a6441292 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:43.748817 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c401c07-7d47-42b2-9a68-7bc5a6441292 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:43.749517 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c401c07-7d47-42b2-9a68-7bc5a6441292 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:43.750052 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c401c07-7d47-42b2-9a68-7bc5a6441292 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:43.750480 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c401c07-7d47-42b2-9a68-7bc5a6441292 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:43.880457 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c401c07-7d47-42b2-9a68-7bc5a6441292 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:43.888094 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c401c07-7d47-42b2-9a68-7bc5a6441292 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.152451 Sep 19 17:27:43.888657 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 255/512] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:43 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:44.220229 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:44.220846 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:44.227612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:44.228210 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:44.228673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:44.229392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:44.229850 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:44.230353 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:44.368257 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:44.377292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:44.378970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:44.380024 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-857a4153-75ef-4fe0-aa97-a66ef25ca736 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.163921 Sep 19 17:27:44.380592 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 258/513] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:44 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:27:44.911636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d59e9d41-4302-49b0-bd70-1005b46d6d01 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:44.912272 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d59e9d41-4302-49b0-bd70-1005b46d6d01 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:44.919076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d59e9d41-4302-49b0-bd70-1005b46d6d01 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:44.919554 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d59e9d41-4302-49b0-bd70-1005b46d6d01 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:44.920021 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d59e9d41-4302-49b0-bd70-1005b46d6d01 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:44.920711 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d59e9d41-4302-49b0-bd70-1005b46d6d01 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:44.921161 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d59e9d41-4302-49b0-bd70-1005b46d6d01 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:44.921582 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d59e9d41-4302-49b0-bd70-1005b46d6d01 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:45.050850 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d59e9d41-4302-49b0-bd70-1005b46d6d01 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:45.058814 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d59e9d41-4302-49b0-bd70-1005b46d6d01 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.151042 Sep 19 17:27:45.059415 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 256/514] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:44 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:45.406293 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:45.406960 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:45.414065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:45.414551 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:45.415022 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:45.415738 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:45.416220 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:45.416646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:45.552822 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:45.561240 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:45.562771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:45.564053 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca3b869f-5e0b-490c-81b3-b273c40afaf6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.161717 Sep 19 17:27:45.564861 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 259/515] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:45 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:46.082639 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-47357b53-fd26-41bc-95f4-ab7eeff0436b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:46.083230 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-47357b53-fd26-41bc-95f4-ab7eeff0436b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:46.089543 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47357b53-fd26-41bc-95f4-ab7eeff0436b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:46.090028 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47357b53-fd26-41bc-95f4-ab7eeff0436b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:46.090460 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47357b53-fd26-41bc-95f4-ab7eeff0436b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:46.091143 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47357b53-fd26-41bc-95f4-ab7eeff0436b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:46.091595 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47357b53-fd26-41bc-95f4-ab7eeff0436b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:46.092043 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47357b53-fd26-41bc-95f4-ab7eeff0436b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:46.217566 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-47357b53-fd26-41bc-95f4-ab7eeff0436b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:46.225077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-47357b53-fd26-41bc-95f4-ab7eeff0436b tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.146927 Sep 19 17:27:46.225643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 257/516] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:46 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:46.589094 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:46.589736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:46.596213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:46.596695 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:46.597241 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:46.597806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:46.598254 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:46.598673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:46.732732 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:46.740861 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:46.742292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:46.743455 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d08ff9c4-4ed6-4b8a-a958-7fb8024e5e61 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.158213 Sep 19 17:27:46.744101 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 260/517] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:46 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:47.247859 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ab3a2dbb-05cf-4f7f-aedd-b5e390e17a80 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:47.248541 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ab3a2dbb-05cf-4f7f-aedd-b5e390e17a80 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:47.256341 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab3a2dbb-05cf-4f7f-aedd-b5e390e17a80 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:47.257040 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab3a2dbb-05cf-4f7f-aedd-b5e390e17a80 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:47.257615 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab3a2dbb-05cf-4f7f-aedd-b5e390e17a80 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:47.258170 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab3a2dbb-05cf-4f7f-aedd-b5e390e17a80 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:47.258624 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab3a2dbb-05cf-4f7f-aedd-b5e390e17a80 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:47.259050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab3a2dbb-05cf-4f7f-aedd-b5e390e17a80 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:47.392168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab3a2dbb-05cf-4f7f-aedd-b5e390e17a80 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:47.399904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ab3a2dbb-05cf-4f7f-aedd-b5e390e17a80 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.156702 Sep 19 17:27:47.400462 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 258/518] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:47 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:47.769086 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:47.769687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:47.776516 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:47.776918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:47.777557 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:47.778250 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:47.778761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:47.779183 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:47.865972 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-54ffb570-22a1-4ff2-b6ba-d72761df57c9 req-da9a1136-e7ba-48c7-bdb8-899beeb59b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32db63e3-5981-4b3d-b998-d41a91dd16db", "name": "network-vif-plugged", "status": "completed", "tag": "ac32b4b1-2aff-4e55-922e-d6e0023c5354"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:27:47.875492 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-54ffb570-22a1-4ff2-b6ba-d72761df57c9 req-da9a1136-e7ba-48c7-bdb8-899beeb59b60 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:47.877778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-54ffb570-22a1-4ff2-b6ba-d72761df57c9 req-da9a1136-e7ba-48c7-bdb8-899beeb59b60 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:47.877778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-54ffb570-22a1-4ff2-b6ba-d72761df57c9 req-da9a1136-e7ba-48c7-bdb8-899beeb59b60 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:47.888196 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-54ffb570-22a1-4ff2-b6ba-d72761df57c9 req-da9a1136-e7ba-48c7-bdb8-899beeb59b60 service nova] Creating event network-vif-plugged:ac32b4b1-2aff-4e55-922e-d6e0023c5354 for instance 32db63e3-5981-4b3d-b998-d41a91dd16db on hv-cinder-84801 Sep 19 17:27:47.893781 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-54ffb570-22a1-4ff2-b6ba-d72761df57c9 req-da9a1136-e7ba-48c7-bdb8-899beeb59b60 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032489 Sep 19 17:27:47.894778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 259/519] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:27:47.914370 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:47.922840 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:47.924806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:47.925970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cfbf689e-4ee9-4194-b472-3ef9ff058dbf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.161095 Sep 19 17:27:47.926533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 261/520] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:47 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:48.424168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-514a9ca3-0261-46d3-b1e9-d9a16194687f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:48.424921 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-514a9ca3-0261-46d3-b1e9-d9a16194687f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:48.431302 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-514a9ca3-0261-46d3-b1e9-d9a16194687f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:48.431933 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-514a9ca3-0261-46d3-b1e9-d9a16194687f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:48.432369 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-514a9ca3-0261-46d3-b1e9-d9a16194687f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:48.433057 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-514a9ca3-0261-46d3-b1e9-d9a16194687f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:48.433512 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-514a9ca3-0261-46d3-b1e9-d9a16194687f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:48.433938 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-514a9ca3-0261-46d3-b1e9-d9a16194687f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:48.570499 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-514a9ca3-0261-46d3-b1e9-d9a16194687f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:48.578217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-514a9ca3-0261-46d3-b1e9-d9a16194687f tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.159512 Sep 19 17:27:48.579185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 260/521] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:48 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:48.953075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:48.953694 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:48.960762 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:48.961251 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:48.961696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:48.962512 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:48.962974 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:48.963402 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:49.089840 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:49.098085 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:49.099783 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:49.100954 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-587c8647-5ad9-4e85-a73f-65268b7d99d4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.151924 Sep 19 17:27:49.101625 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 262/522] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:48 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:27:49.600927 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90951508-f9f2-4e3d-8664-64dbb0534606 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:49.601523 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90951508-f9f2-4e3d-8664-64dbb0534606 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:49.607961 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90951508-f9f2-4e3d-8664-64dbb0534606 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:49.608444 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90951508-f9f2-4e3d-8664-64dbb0534606 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:49.608876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90951508-f9f2-4e3d-8664-64dbb0534606 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:49.609558 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90951508-f9f2-4e3d-8664-64dbb0534606 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:49.610008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90951508-f9f2-4e3d-8664-64dbb0534606 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:49.610429 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90951508-f9f2-4e3d-8664-64dbb0534606 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:49.739560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-90951508-f9f2-4e3d-8664-64dbb0534606 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:49.747747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90951508-f9f2-4e3d-8664-64dbb0534606 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.150571 Sep 19 17:27:49.748302 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 261/523] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:49 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:50.126540 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:50.127648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:50.134840 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:50.135336 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:50.135791 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:50.136481 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:50.136938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:50.137362 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:50.273020 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:50.281106 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:50.282527 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:50.283720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-94140e69-8f71-4d30-b8d2-6bbadf9e1949 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.161358 Sep 19 17:27:50.284302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 263/524] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:50 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:50.770649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0e36c788-20b2-4c31-a2fe-7c742313f522 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:50.771266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0e36c788-20b2-4c31-a2fe-7c742313f522 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:50.777711 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e36c788-20b2-4c31-a2fe-7c742313f522 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:50.778199 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e36c788-20b2-4c31-a2fe-7c742313f522 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:50.778646 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e36c788-20b2-4c31-a2fe-7c742313f522 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:50.779343 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e36c788-20b2-4c31-a2fe-7c742313f522 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:50.779834 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e36c788-20b2-4c31-a2fe-7c742313f522 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:50.780266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e36c788-20b2-4c31-a2fe-7c742313f522 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:50.910245 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e36c788-20b2-4c31-a2fe-7c742313f522 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:50.917897 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0e36c788-20b2-4c31-a2fe-7c742313f522 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1318 microversion: 2.1 time: 0.151446 Sep 19 17:27:50.918456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 262/525] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:50 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:51.309734 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:51.310339 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:51.317177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:51.317654 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:51.318086 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:51.318772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:51.319218 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:51.319638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:51.458052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:51.468505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:51.470176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:51.472777 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-efea3025-3ef0-4a14-bd29-f7c8197ce6a2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.165730 Sep 19 17:27:51.472777 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 264/526] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:51 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:51.941022 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a7269f0-657e-47b4-8c4b-d21e22610c35 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:51.941636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5a7269f0-657e-47b4-8c4b-d21e22610c35 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:51.948323 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7269f0-657e-47b4-8c4b-d21e22610c35 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:51.949215 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7269f0-657e-47b4-8c4b-d21e22610c35 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:51.949215 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7269f0-657e-47b4-8c4b-d21e22610c35 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:51.949707 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7269f0-657e-47b4-8c4b-d21e22610c35 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:51.950170 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7269f0-657e-47b4-8c4b-d21e22610c35 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:51.950599 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7269f0-657e-47b4-8c4b-d21e22610c35 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:52.082881 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5a7269f0-657e-47b4-8c4b-d21e22610c35 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:52.087364 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:52.091162 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5a7269f0-657e-47b4-8c4b-d21e22610c35 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1506 microversion: 2.1 time: 0.154028 Sep 19 17:27:52.091769 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 263/527] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:51 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:52.114948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4cfef958-28b1-4c2a-9dd4-81bdf888f207 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4d0879e-08ac-4821-8ed5-7e4bd6aa66ea", "device": "/dev/sdb"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:27:52.118143 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4cfef958-28b1-4c2a-9dd4-81bdf888f207 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:52.124334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cfef958-28b1-4c2a-9dd4-81bdf888f207 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:52.124826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cfef958-28b1-4c2a-9dd4-81bdf888f207 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:52.125263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cfef958-28b1-4c2a-9dd4-81bdf888f207 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:52.125969 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cfef958-28b1-4c2a-9dd4-81bdf888f207 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:52.126426 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cfef958-28b1-4c2a-9dd4-81bdf888f207 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:52.127348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cfef958-28b1-4c2a-9dd4-81bdf888f207 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:52.145298 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:52.497879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:52.498727 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:52.506557 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:52.507124 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:52.507622 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:52.508990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:52.508990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:52.509257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:52.644400 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:52.652472 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:52.653893 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:52.655037 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9c76456-7ffa-4574-86b9-984df934d181 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.161925 Sep 19 17:27:52.655589 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 264/528] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:52 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:27:52.733488 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4cfef958-28b1-4c2a-9dd4-81bdf888f207 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "POST /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623129 Sep 19 17:27:52.734202 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 265/529] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:27:52 2022] POST /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:27:53.683965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:53.683965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:53.688056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:53.688611 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:53.689058 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:53.689745 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:53.690198 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:53.690621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:53.822279 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:53.830533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:53.832541 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:53.833722 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-433cbe1f-c66f-4730-b9aa-23ce5e24550d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.157005 Sep 19 17:27:53.834287 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 265/530] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:53 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:54.860884 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:54.861621 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:54.869042 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:54.869532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:54.869974 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:54.870668 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:54.871128 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:54.871558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:55.009741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:55.019138 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:55.021149 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:55.022801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9a9da1ee-92c9-483a-bd53-f5b71d0bee19 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.166274 Sep 19 17:27:55.023930 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 266/531] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:54 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:56.057558 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:56.058168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:56.096787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:56.097324 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:56.097795 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:56.098550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:56.099011 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:56.099447 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:56.230278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:56.238926 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:56.240388 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:56.241552 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1f959117-90de-46eb-9899-f744401cb80e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.188004 Sep 19 17:27:56.242110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 266/532] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:56 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:57.203161 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1127268944", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-564527321", "security_groups": [{"name": "tempest-secgroup-smoke-1678939247"}], "networks": [{"uuid": "a3ef60dc-bcdd-4ff6-ab5b-717b5cb805ea"}], "block_device_mapping_v2": [{"uuid": "fc1a9185-b12e-4940-afeb-7db8acb67718", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:27:57.266598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:57.267199 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:57.274009 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:57.274490 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:57.274925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:57.275613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:57.276094 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:57.276517 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:57.328330 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] validate_networks() for [('a3ef60dc-bcdd-4ff6-ab5b-717b5cb805ea', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:27:57.499210 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:57.507489 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:57.508953 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:57.510345 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7ad4d00e-b593-4f36-8c2e-06499ef1433b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.247391 Sep 19 17:27:57.510907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 267/533] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:57 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:27:57.752499 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:27:57.756753 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:27:57.756753 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:27:57.756753 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:27:57.756753 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:27:57.763218 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:57.763717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:57.764516 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:57.764901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:57.765360 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:57.765790 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:57.783892 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Getting quotas for project 4ff66ee28420498aa3f3ac65946c8bca. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:27:57.788690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Getting quotas for user 038341fa1ec446e080145a30f1911a3b and project 4ff66ee28420498aa3f3ac65946c8bca. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:27:57.848020 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:27:57.850183 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc1a9185-b12e-4940-afeb-7db8acb67718',volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:27:58.270560 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e7634e8a-1651-49e2-8901-701abbcef568 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.071084 Sep 19 17:27:58.271483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 267/534] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:27:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:27:58.286497 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-48dcba5d-8120-4c27-86c6-557c781a342e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:58.287125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-48dcba5d-8120-4c27-86c6-557c781a342e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:58.339900 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-48dcba5d-8120-4c27-86c6-557c781a342e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:58.346755 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-48dcba5d-8120-4c27-86c6-557c781a342e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1088 microversion: 2.1 time: 0.064837 Sep 19 17:27:58.350443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 268/535] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:58 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:58.536981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:58.537521 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:58.543776 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:58.544273 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:58.544720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:58.545422 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:58.545880 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:58.546313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:58.672611 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:58.681285 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:58.682804 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:58.684003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0f788d7f-cb02-46f6-9eb1-2dd8a0303de9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.151249 Sep 19 17:27:58.684572 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 268/536] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:58 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:59.373410 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0de4de1b-3062-471c-89e7-484752036c91 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:59.374030 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0de4de1b-3062-471c-89e7-484752036c91 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:59.382091 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0de4de1b-3062-471c-89e7-484752036c91 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:59.382579 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0de4de1b-3062-471c-89e7-484752036c91 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:59.383023 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0de4de1b-3062-471c-89e7-484752036c91 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:59.383757 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0de4de1b-3062-471c-89e7-484752036c91 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:59.384219 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0de4de1b-3062-471c-89e7-484752036c91 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:59.384653 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0de4de1b-3062-471c-89e7-484752036c91 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:59.445976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0de4de1b-3062-471c-89e7-484752036c91 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:59.453851 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0de4de1b-3062-471c-89e7-484752036c91 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1138 microversion: 2.1 time: 0.086324 Sep 19 17:27:59.454416 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 269/537] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:27:59 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:27:59.708965 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:27:59.709519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:27:59.715975 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:59.716454 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:59.716888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:59.717567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:59.718013 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:59.718430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:59.855623 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:59.864575 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:59.866009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:27:59.867169 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-077f0466-f2c3-485a-986f-540e304a9132 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.162195 Sep 19 17:27:59.867754 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 269/538] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:27:59 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:27:59.886396 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-29cae408-d8e7-4653-ac22-f60dfab8901a req-31dd4155-d076-48fb-a3f5-cedd25920865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2eb485-3b5a-4326-bd4f-9029da4e6744", "name": "network-vif-plugged", "status": "completed", "tag": "e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:27:59.892147 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:27:59.908056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-29cae408-d8e7-4653-ac22-f60dfab8901a req-31dd4155-d076-48fb-a3f5-cedd25920865 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:27:59.908545 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-29cae408-d8e7-4653-ac22-f60dfab8901a req-31dd4155-d076-48fb-a3f5-cedd25920865 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:27:59.908981 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-29cae408-d8e7-4653-ac22-f60dfab8901a req-31dd4155-d076-48fb-a3f5-cedd25920865 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:27:59.921209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-29cae408-d8e7-4653-ac22-f60dfab8901a req-31dd4155-d076-48fb-a3f5-cedd25920865 service nova] Creating event network-vif-plugged:e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43 for instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 on hv-cinder-84801 Sep 19 17:27:59.926881 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-29cae408-d8e7-4653-ac22-f60dfab8901a req-31dd4155-d076-48fb-a3f5-cedd25920865 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043959 Sep 19 17:27:59.932809 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 270/539] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:28:00.477467 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3271597b-4ea4-4fe7-9662-28f8c51be147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:00.478082 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3271597b-4ea4-4fe7-9662-28f8c51be147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:00.484068 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3271597b-4ea4-4fe7-9662-28f8c51be147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:00.484561 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3271597b-4ea4-4fe7-9662-28f8c51be147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:00.485004 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3271597b-4ea4-4fe7-9662-28f8c51be147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:00.485698 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3271597b-4ea4-4fe7-9662-28f8c51be147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:00.486186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3271597b-4ea4-4fe7-9662-28f8c51be147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:00.486619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3271597b-4ea4-4fe7-9662-28f8c51be147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:00.545535 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3271597b-4ea4-4fe7-9662-28f8c51be147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:00.553710 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3271597b-4ea4-4fe7-9662-28f8c51be147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1130 microversion: 2.1 time: 0.080165 Sep 19 17:28:00.554277 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 270/540] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:00 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1130 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:00.895452 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:00.896097 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:00.903291 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:00.903806 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:00.904287 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:00.905018 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:00.905476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:00.905907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:01.063656 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:01.081682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:01.081682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:01.081682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-46df7ae5-fdaf-4a5b-a860-9c37d4eab3fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.189566 Sep 19 17:28:01.082164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 271/541] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:00 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:01.576880 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6df35a9c-25a9-49b8-8baf-411d1884a05e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:01.577495 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6df35a9c-25a9-49b8-8baf-411d1884a05e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:01.584772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df35a9c-25a9-49b8-8baf-411d1884a05e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:01.585299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df35a9c-25a9-49b8-8baf-411d1884a05e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:01.588889 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df35a9c-25a9-49b8-8baf-411d1884a05e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:01.588889 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df35a9c-25a9-49b8-8baf-411d1884a05e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:01.588889 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df35a9c-25a9-49b8-8baf-411d1884a05e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:01.588889 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df35a9c-25a9-49b8-8baf-411d1884a05e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:01.651927 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6df35a9c-25a9-49b8-8baf-411d1884a05e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:01.659905 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6df35a9c-25a9-49b8-8baf-411d1884a05e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1186 microversion: 2.1 time: 0.086759 Sep 19 17:28:01.660497 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 271/542] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:01 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:02.107924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:02.108540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:02.115570 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:02.116109 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:02.116745 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:02.117448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:02.118103 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:02.118533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:02.251195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:02.260243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:02.261476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:02.262590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dbed992a-9da7-4ebd-bd61-6d8c4ae9a4fb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.160134 Sep 19 17:28:02.263147 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 272/543] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:02 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:02.682438 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed8a3139-3096-41fd-a61e-d8e4e4ab7c23 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:02.683400 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed8a3139-3096-41fd-a61e-d8e4e4ab7c23 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:02.690453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8a3139-3096-41fd-a61e-d8e4e4ab7c23 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:02.690658 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8a3139-3096-41fd-a61e-d8e4e4ab7c23 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:02.691006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8a3139-3096-41fd-a61e-d8e4e4ab7c23 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:02.691724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8a3139-3096-41fd-a61e-d8e4e4ab7c23 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:02.692200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8a3139-3096-41fd-a61e-d8e4e4ab7c23 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:02.692707 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed8a3139-3096-41fd-a61e-d8e4e4ab7c23 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:02.862074 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed8a3139-3096-41fd-a61e-d8e4e4ab7c23 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:02.869860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed8a3139-3096-41fd-a61e-d8e4e4ab7c23 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1272 microversion: 2.1 time: 0.191315 Sep 19 17:28:02.870479 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 272/544] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:02 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:03.288344 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:03.288958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:03.295316 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:03.295834 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:03.296277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:03.296970 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:03.297427 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:03.297860 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:03.429671 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:03.437558 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:03.438968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:03.440240 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eece2133-1bae-4c55-89cb-08e26dd0622a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.155792 Sep 19 17:28:03.441459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 273/545] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:03 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:03.891918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b79fe6f8-f847-499e-8d5a-2b642c99c1e3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:03.892536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b79fe6f8-f847-499e-8d5a-2b642c99c1e3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:03.899686 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b79fe6f8-f847-499e-8d5a-2b642c99c1e3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:03.900216 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b79fe6f8-f847-499e-8d5a-2b642c99c1e3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:03.900653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b79fe6f8-f847-499e-8d5a-2b642c99c1e3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:03.901350 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b79fe6f8-f847-499e-8d5a-2b642c99c1e3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:03.901809 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b79fe6f8-f847-499e-8d5a-2b642c99c1e3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:03.902236 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b79fe6f8-f847-499e-8d5a-2b642c99c1e3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:04.036856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b79fe6f8-f847-499e-8d5a-2b642c99c1e3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:04.044631 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b79fe6f8-f847-499e-8d5a-2b642c99c1e3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1272 microversion: 2.1 time: 0.156640 Sep 19 17:28:04.050520 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 273/546] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:03 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:04.466422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:04.467032 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:04.473520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:04.474242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:04.474707 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:04.475588 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:04.476072 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:04.476537 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:04.610669 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:04.619662 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:04.621102 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:04.622269 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0876a961-9aed-4e7a-82f6-1c9a000255b6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.159794 Sep 19 17:28:04.622826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 274/547] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:04 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:05.067174 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9414c773-271b-400f-9254-e392036a948a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:05.067899 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9414c773-271b-400f-9254-e392036a948a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:05.074347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9414c773-271b-400f-9254-e392036a948a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:05.074836 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9414c773-271b-400f-9254-e392036a948a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:05.075274 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9414c773-271b-400f-9254-e392036a948a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:05.075999 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9414c773-271b-400f-9254-e392036a948a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:05.076451 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9414c773-271b-400f-9254-e392036a948a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:05.076878 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9414c773-271b-400f-9254-e392036a948a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:05.191857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-36ce08b3-19a4-44ee-8646-cab6d598f6ba req-046bd46e-c76b-4a33-876c-bfa86476272f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9442149d-db6c-4fd9-b92a-3eaf3e8c2046", "tag": "ddae7d4a-71c6-4777-a374-39594620566f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:28:05.202002 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-36ce08b3-19a4-44ee-8646-cab6d598f6ba req-046bd46e-c76b-4a33-876c-bfa86476272f service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:05.202495 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-36ce08b3-19a4-44ee-8646-cab6d598f6ba req-046bd46e-c76b-4a33-876c-bfa86476272f service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:05.202941 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-36ce08b3-19a4-44ee-8646-cab6d598f6ba req-046bd46e-c76b-4a33-876c-bfa86476272f service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:05.208847 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9414c773-271b-400f-9254-e392036a948a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:05.214738 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-36ce08b3-19a4-44ee-8646-cab6d598f6ba req-046bd46e-c76b-4a33-876c-bfa86476272f service nova] Creating event network-changed:ddae7d4a-71c6-4777-a374-39594620566f for instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 on hv-cinder-84801 Sep 19 17:28:05.216712 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9414c773-271b-400f-9254-e392036a948a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1272 microversion: 2.1 time: 0.153623 Sep 19 17:28:05.217302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 274/548] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:05 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:05.219913 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-36ce08b3-19a4-44ee-8646-cab6d598f6ba req-046bd46e-c76b-4a33-876c-bfa86476272f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031862 Sep 19 17:28:05.220520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 275/549] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:28:05.648281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:05.648905 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:05.655253 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:05.655820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:05.656265 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:05.656961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:05.657468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:05.657897 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:05.791888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:05.800220 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:05.801641 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:05.802794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-023493f4-4fc3-4d86-9c55-2063ba291407 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.158821 Sep 19 17:28:05.803340 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 275/550] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:05 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:06.241107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b64dc3f0-e372-4332-a875-e1e7a5c78c74 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:06.241874 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b64dc3f0-e372-4332-a875-e1e7a5c78c74 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:06.249044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b64dc3f0-e372-4332-a875-e1e7a5c78c74 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:06.249549 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b64dc3f0-e372-4332-a875-e1e7a5c78c74 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:06.250031 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b64dc3f0-e372-4332-a875-e1e7a5c78c74 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:06.250787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b64dc3f0-e372-4332-a875-e1e7a5c78c74 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:06.251257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b64dc3f0-e372-4332-a875-e1e7a5c78c74 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:06.251784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b64dc3f0-e372-4332-a875-e1e7a5c78c74 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:06.391526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b64dc3f0-e372-4332-a875-e1e7a5c78c74 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:06.399999 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b64dc3f0-e372-4332-a875-e1e7a5c78c74 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1272 microversion: 2.1 time: 0.163412 Sep 19 17:28:06.400902 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 276/551] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:06 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:06.827623 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:06.828263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:06.834689 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:06.835165 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:06.835612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:06.836307 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:06.836758 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:06.837178 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:06.966685 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:06.975334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:06.978391 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:06.978391 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c466cf92-bd6e-4936-a9e6-ceb64496314b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.154146 Sep 19 17:28:06.978676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 276/552] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:06 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:07.422653 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7478a71d-94ef-4c74-8cec-441e460e77f4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:07.423177 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7478a71d-94ef-4c74-8cec-441e460e77f4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:07.429853 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7478a71d-94ef-4c74-8cec-441e460e77f4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:07.430317 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7478a71d-94ef-4c74-8cec-441e460e77f4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:07.430747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7478a71d-94ef-4c74-8cec-441e460e77f4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:07.431438 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7478a71d-94ef-4c74-8cec-441e460e77f4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:07.431920 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7478a71d-94ef-4c74-8cec-441e460e77f4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:07.432342 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7478a71d-94ef-4c74-8cec-441e460e77f4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:07.572796 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7478a71d-94ef-4c74-8cec-441e460e77f4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:07.580534 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7478a71d-94ef-4c74-8cec-441e460e77f4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1272 microversion: 2.1 time: 0.161823 Sep 19 17:28:07.581322 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 277/553] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:07 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:08.004821 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:08.009071 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:08.009071 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:08.009071 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:08.013429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:08.013947 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:08.014390 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:08.015083 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:08.015540 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:08.015999 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:08.145454 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:08.153715 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:08.155169 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:08.156415 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4488043a-2e06-4fe4-accc-01c23b4e8871 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.156126 Sep 19 17:28:08.163282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 277/554] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:07 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:08.603949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c96bf75-2f80-4421-9808-59dd039ce682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:08.604549 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c96bf75-2f80-4421-9808-59dd039ce682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:08.606497 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:08.611638 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c96bf75-2f80-4421-9808-59dd039ce682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:08.612145 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c96bf75-2f80-4421-9808-59dd039ce682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:08.613128 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c96bf75-2f80-4421-9808-59dd039ce682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:08.613816 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c96bf75-2f80-4421-9808-59dd039ce682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:08.614266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c96bf75-2f80-4421-9808-59dd039ce682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:08.614688 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c96bf75-2f80-4421-9808-59dd039ce682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:08.748254 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c96bf75-2f80-4421-9808-59dd039ce682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:08.755927 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c96bf75-2f80-4421-9808-59dd039ce682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1272 microversion: 2.1 time: 0.155928 Sep 19 17:28:08.756491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 278/555] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:08 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:09.181526 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:09.182167 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:09.188995 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:09.189480 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:09.189920 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:09.191277 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:09.191784 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:09.192174 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:09.331909 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:09.340281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:09.342641 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:09.344136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9aa7ccb7-be55-4519-9bf9-ac8bc3dc9347 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.166595 Sep 19 17:28:09.344713 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 278/556] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:09 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:09.779238 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-91c4e1b6-7f18-4b83-b386-b102a612e270 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:09.779894 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-91c4e1b6-7f18-4b83-b386-b102a612e270 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:09.786374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91c4e1b6-7f18-4b83-b386-b102a612e270 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:09.786865 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91c4e1b6-7f18-4b83-b386-b102a612e270 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:09.787307 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91c4e1b6-7f18-4b83-b386-b102a612e270 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:09.788038 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91c4e1b6-7f18-4b83-b386-b102a612e270 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:09.788494 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91c4e1b6-7f18-4b83-b386-b102a612e270 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:09.788924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91c4e1b6-7f18-4b83-b386-b102a612e270 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:09.920991 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-91c4e1b6-7f18-4b83-b386-b102a612e270 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:09.929499 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-91c4e1b6-7f18-4b83-b386-b102a612e270 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.154140 Sep 19 17:28:09.930063 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 279/557] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:09 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:10.369839 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:10.370449 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:10.376964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:10.377438 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:10.377873 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:10.378560 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:10.379009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:10.379429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:10.517129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:10.525943 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:10.527393 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:10.528602 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93ae05b5-213e-4679-ba2c-7986b5b242f4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.162753 Sep 19 17:28:10.529166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 279/558] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:10 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:10.952297 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-35902bec-4c42-46c3-beb2-de4e49ed0993 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:10.952913 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-35902bec-4c42-46c3-beb2-de4e49ed0993 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:10.959479 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35902bec-4c42-46c3-beb2-de4e49ed0993 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:10.959992 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35902bec-4c42-46c3-beb2-de4e49ed0993 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:10.960432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35902bec-4c42-46c3-beb2-de4e49ed0993 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:10.961159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35902bec-4c42-46c3-beb2-de4e49ed0993 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:10.961608 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35902bec-4c42-46c3-beb2-de4e49ed0993 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:10.962035 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35902bec-4c42-46c3-beb2-de4e49ed0993 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:11.091581 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-35902bec-4c42-46c3-beb2-de4e49ed0993 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:11.099189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-35902bec-4c42-46c3-beb2-de4e49ed0993 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.150788 Sep 19 17:28:11.099778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 280/559] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:10 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:11.554866 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:11.555520 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:11.557930 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:11.562674 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:11.563196 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:11.563587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:11.564303 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:11.564755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:11.565176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:11.696769 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:11.705299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:11.707258 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:11.708467 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d76df163-8c90-45ab-89ea-0ee7436d7b2d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.157476 Sep 19 17:28:11.709039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 280/560] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:11 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:12.122179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-18ff9659-021d-4116-91c5-1ff7d89a4010 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:12.122793 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-18ff9659-021d-4116-91c5-1ff7d89a4010 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:12.131279 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18ff9659-021d-4116-91c5-1ff7d89a4010 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:12.131797 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18ff9659-021d-4116-91c5-1ff7d89a4010 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:12.132235 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18ff9659-021d-4116-91c5-1ff7d89a4010 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:12.132918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18ff9659-021d-4116-91c5-1ff7d89a4010 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:12.133368 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18ff9659-021d-4116-91c5-1ff7d89a4010 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:12.133787 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18ff9659-021d-4116-91c5-1ff7d89a4010 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:12.261934 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-18ff9659-021d-4116-91c5-1ff7d89a4010 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:12.270521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-18ff9659-021d-4116-91c5-1ff7d89a4010 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.152167 Sep 19 17:28:12.271093 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 281/561] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:12 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:12.734736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:12.735356 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:12.742405 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:12.742890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:12.743332 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:12.744059 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:12.744523 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:12.744984 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:12.763204 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:12.879040 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:12.887432 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:12.889081 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:12.890258 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-326f1a0a-a34b-4b34-956c-8bf7d64bb828 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.159539 Sep 19 17:28:12.890819 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 281/562] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:12 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:13.293317 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4c4cac5-9f9d-4f6f-987a-41fcb29316df tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:13.293912 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4c4cac5-9f9d-4f6f-987a-41fcb29316df tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:13.300281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c4cac5-9f9d-4f6f-987a-41fcb29316df tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:13.300784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c4cac5-9f9d-4f6f-987a-41fcb29316df tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:13.301217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c4cac5-9f9d-4f6f-987a-41fcb29316df tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:13.301897 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c4cac5-9f9d-4f6f-987a-41fcb29316df tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:13.302345 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c4cac5-9f9d-4f6f-987a-41fcb29316df tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:13.302763 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c4cac5-9f9d-4f6f-987a-41fcb29316df tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:13.433390 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4c4cac5-9f9d-4f6f-987a-41fcb29316df tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:13.436842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:13.441419 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4c4cac5-9f9d-4f6f-987a-41fcb29316df tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.152066 Sep 19 17:28:13.441994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 282/563] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:13 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:13.916149 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:13.916766 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:13.923734 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:13.924212 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:13.924672 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:13.925866 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:13.926324 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:13.926747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:14.058682 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:14.067284 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:14.068737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:14.069894 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-07b6b402-557d-4852-8b59-bb14de683224 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.157678 Sep 19 17:28:14.070456 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 282/564] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:13 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:14.470792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-96a23724-84f4-4367-b5e4-e898ed75b3a7 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:14.471422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-96a23724-84f4-4367-b5e4-e898ed75b3a7 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:14.478880 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96a23724-84f4-4367-b5e4-e898ed75b3a7 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:14.479366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96a23724-84f4-4367-b5e4-e898ed75b3a7 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:14.479850 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96a23724-84f4-4367-b5e4-e898ed75b3a7 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:14.480553 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96a23724-84f4-4367-b5e4-e898ed75b3a7 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:14.481204 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96a23724-84f4-4367-b5e4-e898ed75b3a7 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:14.481899 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96a23724-84f4-4367-b5e4-e898ed75b3a7 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:14.619566 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-96a23724-84f4-4367-b5e4-e898ed75b3a7 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:14.627180 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-96a23724-84f4-4367-b5e4-e898ed75b3a7 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.160603 Sep 19 17:28:14.627766 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 283/565] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:14 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:15.094916 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:15.095522 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:15.102032 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:15.102515 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:15.102955 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:15.103643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:15.104150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:15.104549 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:15.234655 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:15.242784 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:15.244303 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:15.245460 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b1b14b0-e0dc-4623-98ae-fc49dd22ec04 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.154474 Sep 19 17:28:15.246024 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 283/566] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:15 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:15.649915 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e81c883f-cfbf-4343-9f0c-aa91494b78a5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:15.650470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e81c883f-cfbf-4343-9f0c-aa91494b78a5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:15.656752 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81c883f-cfbf-4343-9f0c-aa91494b78a5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:15.657236 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81c883f-cfbf-4343-9f0c-aa91494b78a5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:15.657678 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81c883f-cfbf-4343-9f0c-aa91494b78a5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:15.658370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81c883f-cfbf-4343-9f0c-aa91494b78a5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:15.658832 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81c883f-cfbf-4343-9f0c-aa91494b78a5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:15.659257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81c883f-cfbf-4343-9f0c-aa91494b78a5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:15.798784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e81c883f-cfbf-4343-9f0c-aa91494b78a5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:15.807540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e81c883f-cfbf-4343-9f0c-aa91494b78a5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.161560 Sep 19 17:28:15.808246 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 284/567] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:15 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:16.272156 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:16.272698 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:16.279317 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:16.279841 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:16.280287 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:16.280988 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:16.281448 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:16.281914 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:16.423363 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:16.428942 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:16.430431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:16.431619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a2ca2aee-5157-42c0-8bc7-281a07a157f5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1743 microversion: 2.20 time: 0.164211 Sep 19 17:28:16.432287 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 284/568] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:16 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:28:16.830662 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f4811d2-4889-4aa3-b3c6-b81b19bae1b1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:16.831241 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0f4811d2-4889-4aa3-b3c6-b81b19bae1b1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:16.838512 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4811d2-4889-4aa3-b3c6-b81b19bae1b1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:16.838937 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4811d2-4889-4aa3-b3c6-b81b19bae1b1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:16.839379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4811d2-4889-4aa3-b3c6-b81b19bae1b1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:16.840132 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4811d2-4889-4aa3-b3c6-b81b19bae1b1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:16.840599 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4811d2-4889-4aa3-b3c6-b81b19bae1b1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:16.841026 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f4811d2-4889-4aa3-b3c6-b81b19bae1b1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:17.081797 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0f4811d2-4889-4aa3-b3c6-b81b19bae1b1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:17.090583 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f4811d2-4889-4aa3-b3c6-b81b19bae1b1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.263608 Sep 19 17:28:17.091670 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 285/569] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:16 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:17.465916 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:17.466517 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:17.473593 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:17.474352 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:17.475050 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:17.475710 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:17.476167 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:17.476590 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:17.615024 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:17.626824 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:17.628613 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:17.629893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6cdb0a9e-3a44-41d9-be56-de4fe89363d3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.167972 Sep 19 17:28:17.630810 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 285/570] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:17 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:18.114814 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42e9ee54-710c-4e6c-b97b-53d2392793fe tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:18.115431 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-42e9ee54-710c-4e6c-b97b-53d2392793fe tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:18.122132 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42e9ee54-710c-4e6c-b97b-53d2392793fe tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:18.122583 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42e9ee54-710c-4e6c-b97b-53d2392793fe tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:18.123026 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42e9ee54-710c-4e6c-b97b-53d2392793fe tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:18.123820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42e9ee54-710c-4e6c-b97b-53d2392793fe tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:18.124282 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42e9ee54-710c-4e6c-b97b-53d2392793fe tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:18.124711 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42e9ee54-710c-4e6c-b97b-53d2392793fe tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:18.262151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-42e9ee54-710c-4e6c-b97b-53d2392793fe tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:18.270445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42e9ee54-710c-4e6c-b97b-53d2392793fe tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.160080 Sep 19 17:28:18.271016 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 286/571] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:18 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:18.658010 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:18.658788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:18.666775 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:18.668310 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:18.669170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:18.670010 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:18.670599 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:18.671097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:18.827616 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:18.841979 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:18.844699 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:18.846066 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74a8a91c-a137-4e63-aea1-d57112c4dcfe tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.192209 Sep 19 17:28:18.864695 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 286/572] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:18 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:19.294595 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5b99bff3-d05a-47ce-ad15-7a8735625c8d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:19.295943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5b99bff3-d05a-47ce-ad15-7a8735625c8d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:19.304572 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b99bff3-d05a-47ce-ad15-7a8735625c8d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:19.305051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b99bff3-d05a-47ce-ad15-7a8735625c8d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:19.305520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b99bff3-d05a-47ce-ad15-7a8735625c8d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:19.306213 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b99bff3-d05a-47ce-ad15-7a8735625c8d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:19.306664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b99bff3-d05a-47ce-ad15-7a8735625c8d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:19.307080 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b99bff3-d05a-47ce-ad15-7a8735625c8d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:19.476743 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5b99bff3-d05a-47ce-ad15-7a8735625c8d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:19.486389 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5b99bff3-d05a-47ce-ad15-7a8735625c8d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.195698 Sep 19 17:28:19.487022 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 287/573] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:19 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:19.875961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:19.877355 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:19.892936 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:19.902780 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:19.904824 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:19.906178 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:19.906997 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:19.907857 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:20.160597 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:20.171437 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:20.173219 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:20.174895 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe6c8500-80cb-46eb-9df6-f8684c1479b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.303073 Sep 19 17:28:20.175873 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 287/574] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:19 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:20.177281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3d1b0ac8-f0ba-452f-b365-888e58d9aaf8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:20.177962 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3d1b0ac8-f0ba-452f-b365-888e58d9aaf8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:20.184443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d1b0ac8-f0ba-452f-b365-888e58d9aaf8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:20.185433 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d1b0ac8-f0ba-452f-b365-888e58d9aaf8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:20.185874 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d1b0ac8-f0ba-452f-b365-888e58d9aaf8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:20.186903 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d1b0ac8-f0ba-452f-b365-888e58d9aaf8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:20.187550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d1b0ac8-f0ba-452f-b365-888e58d9aaf8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:20.188263 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d1b0ac8-f0ba-452f-b365-888e58d9aaf8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:20.319664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-3d1b0ac8-f0ba-452f-b365-888e58d9aaf8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lazy-loading 'services' on Instance uuid 32db63e3-5981-4b3d-b998-d41a91dd16db {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:28:20.513547 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c575045b-fef9-4019-82be-5c93dfb03073 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:20.514095 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c575045b-fef9-4019-82be-5c93dfb03073 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:20.521792 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c575045b-fef9-4019-82be-5c93dfb03073 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:20.522266 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c575045b-fef9-4019-82be-5c93dfb03073 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:20.522716 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c575045b-fef9-4019-82be-5c93dfb03073 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:20.523450 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c575045b-fef9-4019-82be-5c93dfb03073 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:20.524025 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c575045b-fef9-4019-82be-5c93dfb03073 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:20.524466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c575045b-fef9-4019-82be-5c93dfb03073 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:20.655170 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3d1b0ac8-f0ba-452f-b365-888e58d9aaf8 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "DELETE /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db/os-volume_attachments/b4d0879e-08ac-4821-8ed5-7e4bd6aa66ea" status: 202 len: 0 microversion: 2.1 time: 0.482367 Sep 19 17:28:20.655762 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 288/575] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:28:20 2022] DELETE /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db/os-volume_attachments/b4d0879e-08ac-4821-8ed5-7e4bd6aa66ea => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:28:20.726835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c575045b-fef9-4019-82be-5c93dfb03073 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:20.734748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c575045b-fef9-4019-82be-5c93dfb03073 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.226235 Sep 19 17:28:20.735320 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 288/576] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:20 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:21.201492 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:21.202691 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:21.209498 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:21.210086 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:21.210723 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:21.211578 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:21.212245 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:21.212885 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:21.354857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:21.365256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:21.367208 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:21.369367 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-47396464-0dc2-4301-9d39-b3d79c073ed3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.172099 Sep 19 17:28:21.384467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 289/577] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:21 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:21.759231 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6cc199c2-95cf-4261-b43d-6d2098ead407 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:21.760611 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6cc199c2-95cf-4261-b43d-6d2098ead407 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:21.769290 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc199c2-95cf-4261-b43d-6d2098ead407 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:21.771471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc199c2-95cf-4261-b43d-6d2098ead407 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:21.773272 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc199c2-95cf-4261-b43d-6d2098ead407 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:21.774004 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc199c2-95cf-4261-b43d-6d2098ead407 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:21.774465 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc199c2-95cf-4261-b43d-6d2098ead407 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:21.774903 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc199c2-95cf-4261-b43d-6d2098ead407 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:21.935171 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6cc199c2-95cf-4261-b43d-6d2098ead407 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:21.943676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6cc199c2-95cf-4261-b43d-6d2098ead407 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.188302 Sep 19 17:28:21.944636 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 289/578] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:21 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:22.518220 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:22.518848 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:22.527983 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:22.528847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:22.529376 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:22.530154 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:22.530719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:22.531213 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:22.676106 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:22.685238 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:22.686803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:22.688057 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6750f696-b058-46a1-bebb-c8745458f79a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.295440 Sep 19 17:28:22.688609 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 290/579] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:22 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:22.972913 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1b5bac3-0e5d-4d94-8d02-d8848e61f0bb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:22.975232 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1b5bac3-0e5d-4d94-8d02-d8848e61f0bb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:22.982263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1b5bac3-0e5d-4d94-8d02-d8848e61f0bb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:22.982863 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1b5bac3-0e5d-4d94-8d02-d8848e61f0bb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:22.983990 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1b5bac3-0e5d-4d94-8d02-d8848e61f0bb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:22.984726 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1b5bac3-0e5d-4d94-8d02-d8848e61f0bb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:22.985232 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1b5bac3-0e5d-4d94-8d02-d8848e61f0bb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:22.985656 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1b5bac3-0e5d-4d94-8d02-d8848e61f0bb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:23.340158 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1b5bac3-0e5d-4d94-8d02-d8848e61f0bb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:23.350643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1b5bac3-0e5d-4d94-8d02-d8848e61f0bb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.384009 Sep 19 17:28:23.351439 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 290/580] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:22 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:23.716257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:23.716866 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:23.724077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:23.724560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:23.724996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:23.725764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:23.726218 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:23.726643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:23.858657 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:23.866914 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:23.868407 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:23.869721 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eb10f2e9-9703-473d-b2c5-37238bcdebc5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.159328 Sep 19 17:28:23.870386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 291/581] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:23 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:24.375260 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e6c6cfd-1d7d-401b-861a-a1fdce4c0b5e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:24.375904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5e6c6cfd-1d7d-401b-861a-a1fdce4c0b5e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:24.382934 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6c6cfd-1d7d-401b-861a-a1fdce4c0b5e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:24.383421 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6c6cfd-1d7d-401b-861a-a1fdce4c0b5e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:24.383884 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6c6cfd-1d7d-401b-861a-a1fdce4c0b5e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:24.384580 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6c6cfd-1d7d-401b-861a-a1fdce4c0b5e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:24.385033 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6c6cfd-1d7d-401b-861a-a1fdce4c0b5e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:24.385451 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6c6cfd-1d7d-401b-861a-a1fdce4c0b5e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:24.539031 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5e6c6cfd-1d7d-401b-861a-a1fdce4c0b5e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:24.548087 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5e6c6cfd-1d7d-401b-861a-a1fdce4c0b5e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.177933 Sep 19 17:28:24.548669 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 291/582] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:24 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:24.898590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:24.900044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:24.909627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:24.910289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:24.911082 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:24.912454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:24.913332 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:24.913990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:25.059334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-13f988f0-1fe3-4bf3-8a3d-280be5d9ec7a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:25.060819 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-13f988f0-1fe3-4bf3-8a3d-280be5d9ec7a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:25.068429 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:25.075782 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f988f0-1fe3-4bf3-8a3d-280be5d9ec7a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:25.076877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f988f0-1fe3-4bf3-8a3d-280be5d9ec7a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:25.077800 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f988f0-1fe3-4bf3-8a3d-280be5d9ec7a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:25.078622 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:25.079065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f988f0-1fe3-4bf3-8a3d-280be5d9ec7a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:25.079935 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f988f0-1fe3-4bf3-8a3d-280be5d9ec7a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:25.080141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:25.080784 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f988f0-1fe3-4bf3-8a3d-280be5d9ec7a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:25.081279 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5587d7b1-1d40-479b-8279-efa6ea792e01 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.187770 Sep 19 17:28:25.084419 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 292/583] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:24 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:25.143872 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-13f988f0-1fe3-4bf3-8a3d-280be5d9ec7a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:28:25.569899 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-13f988f0-1fe3-4bf3-8a3d-280be5d9ec7a tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "DELETE /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 204 len: 0 microversion: 2.1 time: 0.514171 Sep 19 17:28:25.573863 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-568796f7-5741-4684-832d-fee79ffb0124 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:25.577208 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-568796f7-5741-4684-832d-fee79ffb0124 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:25.578854 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 292/584] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:28:25 2022] DELETE /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:28:25.584704 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65f7e780-2b2f-4c89-aa52-ec54933374f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:25.585720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-65f7e780-2b2f-4c89-aa52-ec54933374f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:25.587142 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568796f7-5741-4684-832d-fee79ffb0124 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:25.588091 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568796f7-5741-4684-832d-fee79ffb0124 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:25.588680 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568796f7-5741-4684-832d-fee79ffb0124 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:25.589652 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568796f7-5741-4684-832d-fee79ffb0124 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:25.590885 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568796f7-5741-4684-832d-fee79ffb0124 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:25.592133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568796f7-5741-4684-832d-fee79ffb0124 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:25.594011 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7e780-2b2f-4c89-aa52-ec54933374f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:25.594612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7e780-2b2f-4c89-aa52-ec54933374f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:25.595260 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7e780-2b2f-4c89-aa52-ec54933374f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:25.596619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7e780-2b2f-4c89-aa52-ec54933374f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:25.597137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7e780-2b2f-4c89-aa52-ec54933374f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:25.597618 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7e780-2b2f-4c89-aa52-ec54933374f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:25.828732 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-568796f7-5741-4684-832d-fee79ffb0124 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:25.838050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-568796f7-5741-4684-832d-fee79ffb0124 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.269726 Sep 19 17:28:25.838499 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-65f7e780-2b2f-4c89-aa52-ec54933374f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:25.839308 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 293/585] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:25 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:25.846210 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-65f7e780-2b2f-4c89-aa52-ec54933374f9 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1512 microversion: 2.1 time: 0.265881 Sep 19 17:28:25.852336 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 293/586] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:25 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:26.107242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:26.108726 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:26.120584 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:26.121555 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:26.122245 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:26.123126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:26.124412 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:26.124994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:26.284280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:26.296777 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:26.297033 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:26.298281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5169ef62-681b-4206-9ff3-7f6693e7a5b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.194914 Sep 19 17:28:26.299989 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 294/587] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:26 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:26.862528 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20157c25-1fc9-4246-9232-bc6053b2776a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:26.864137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-20157c25-1fc9-4246-9232-bc6053b2776a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:26.870213 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8905a684-ae0a-4aa3-9e73-bdbdcd1e3812 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:26.871467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8905a684-ae0a-4aa3-9e73-bdbdcd1e3812 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:26.885160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8905a684-ae0a-4aa3-9e73-bdbdcd1e3812 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:26.886363 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20157c25-1fc9-4246-9232-bc6053b2776a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:26.886860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20157c25-1fc9-4246-9232-bc6053b2776a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:26.887331 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20157c25-1fc9-4246-9232-bc6053b2776a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:26.888044 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20157c25-1fc9-4246-9232-bc6053b2776a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:26.888699 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8905a684-ae0a-4aa3-9e73-bdbdcd1e3812 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:26.889316 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8905a684-ae0a-4aa3-9e73-bdbdcd1e3812 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:26.890186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8905a684-ae0a-4aa3-9e73-bdbdcd1e3812 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:26.891675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20157c25-1fc9-4246-9232-bc6053b2776a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:26.892018 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8905a684-ae0a-4aa3-9e73-bdbdcd1e3812 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:26.893361 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20157c25-1fc9-4246-9232-bc6053b2776a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:26.897027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8905a684-ae0a-4aa3-9e73-bdbdcd1e3812 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:27.124241 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8905a684-ae0a-4aa3-9e73-bdbdcd1e3812 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:27.133882 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8905a684-ae0a-4aa3-9e73-bdbdcd1e3812 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1512 microversion: 2.1 time: 0.266932 Sep 19 17:28:27.136310 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-20157c25-1fc9-4246-9232-bc6053b2776a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:27.145554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-20157c25-1fc9-4246-9232-bc6053b2776a tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.287016 Sep 19 17:28:27.146303 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 294/588] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:26 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:27.148357 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 295/589] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:26 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1512 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:28:27.327226 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:27.327976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:27.334763 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:27.335283 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:27.335800 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:27.336596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:27.337053 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:27.337525 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:27.492720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:27.492720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:27.493020 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:27.494119 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2cb641b3-0404-4736-a427-550b83723a09 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.170919 Sep 19 17:28:27.494930 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 295/590] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:27 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:28:27.886109 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-580b566c-0679-4b50-bf7a-b3c4c2170190 req-b6b89d2d-72b2-4b25-92cc-9fdfc6184008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9442149d-db6c-4fd9-b92a-3eaf3e8c2046", "name": "network-vif-plugged", "status": "completed", "tag": "ddae7d4a-71c6-4777-a374-39594620566f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:28:27.895921 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-580b566c-0679-4b50-bf7a-b3c4c2170190 req-b6b89d2d-72b2-4b25-92cc-9fdfc6184008 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:27.896402 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-580b566c-0679-4b50-bf7a-b3c4c2170190 req-b6b89d2d-72b2-4b25-92cc-9fdfc6184008 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:27.896830 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-580b566c-0679-4b50-bf7a-b3c4c2170190 req-b6b89d2d-72b2-4b25-92cc-9fdfc6184008 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:27.907932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-580b566c-0679-4b50-bf7a-b3c4c2170190 req-b6b89d2d-72b2-4b25-92cc-9fdfc6184008 service nova] Creating event network-vif-plugged:ddae7d4a-71c6-4777-a374-39594620566f for instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 on hv-cinder-84801 Sep 19 17:28:27.913486 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-580b566c-0679-4b50-bf7a-b3c4c2170190 req-b6b89d2d-72b2-4b25-92cc-9fdfc6184008 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031028 Sep 19 17:28:27.914104 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 296/591] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:28:28.157770 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e13b8f2a-d927-4e08-b1a1-c4ad026598e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:28.158516 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e13b8f2a-d927-4e08-b1a1-c4ad026598e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:28.167279 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13b8f2a-d927-4e08-b1a1-c4ad026598e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:28.167944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13b8f2a-d927-4e08-b1a1-c4ad026598e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:28.168379 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13b8f2a-d927-4e08-b1a1-c4ad026598e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:28.169077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13b8f2a-d927-4e08-b1a1-c4ad026598e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:28.169533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13b8f2a-d927-4e08-b1a1-c4ad026598e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:28.170229 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13b8f2a-d927-4e08-b1a1-c4ad026598e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:28.171972 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aa517545-8857-4773-bff3-a401784e46f2 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:28.172701 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aa517545-8857-4773-bff3-a401784e46f2 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:28.183591 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa517545-8857-4773-bff3-a401784e46f2 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:28.189725 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa517545-8857-4773-bff3-a401784e46f2 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:28.190349 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa517545-8857-4773-bff3-a401784e46f2 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:28.191096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa517545-8857-4773-bff3-a401784e46f2 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:28.191634 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa517545-8857-4773-bff3-a401784e46f2 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:28.192078 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa517545-8857-4773-bff3-a401784e46f2 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:28.196194 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:28.434952 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e13b8f2a-d927-4e08-b1a1-c4ad026598e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:28.457214 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e13b8f2a-d927-4e08-b1a1-c4ad026598e1 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1512 microversion: 2.1 time: 0.303298 Sep 19 17:28:28.468530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 296/592] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:28 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:28:28.504895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-aa517545-8857-4773-bff3-a401784e46f2 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:28.515041 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aa517545-8857-4773-bff3-a401784e46f2 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.348672 Sep 19 17:28:28.527722 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:28.527722 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:28.528748 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 297/593] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:28 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:28:28.533044 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:28.534400 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:28.536777 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:28.538178 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:28.538984 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:28.539535 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:28.728449 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:28.737604 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:28.739250 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:28.741129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47af7453-fb6a-4b83-8007-28b38e692ba3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.225080 Sep 19 17:28:28.759483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 297/594] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:28 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:28:29.278136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-c9c4bf93-8863-495e-8252-a20cb94e6b67 req-2a86960f-04a4-42b6-9c64-829a504bedaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32db63e3-5981-4b3d-b998-d41a91dd16db", "name": "network-vif-deleted", "tag": "ac32b4b1-2aff-4e55-922e-d6e0023c5354"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:28:29.288403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c9c4bf93-8863-495e-8252-a20cb94e6b67 req-2a86960f-04a4-42b6-9c64-829a504bedaf service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:29.288924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c9c4bf93-8863-495e-8252-a20cb94e6b67 req-2a86960f-04a4-42b6-9c64-829a504bedaf service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:29.289364 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c9c4bf93-8863-495e-8252-a20cb94e6b67 req-2a86960f-04a4-42b6-9c64-829a504bedaf service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:29.302400 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-c9c4bf93-8863-495e-8252-a20cb94e6b67 req-2a86960f-04a4-42b6-9c64-829a504bedaf service nova] Creating event network-vif-deleted:ac32b4b1-2aff-4e55-922e-d6e0023c5354 for instance 32db63e3-5981-4b3d-b998-d41a91dd16db on hv-cinder-84801 Sep 19 17:28:29.307341 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-c9c4bf93-8863-495e-8252-a20cb94e6b67 req-2a86960f-04a4-42b6-9c64-829a504bedaf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Sep 19 17:28:29.310039 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 298/595] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:28:29.490751 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-80bb29cb-0a3a-449d-8ebb-7044a41fa261 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:29.491371 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-80bb29cb-0a3a-449d-8ebb-7044a41fa261 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:29.498042 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80bb29cb-0a3a-449d-8ebb-7044a41fa261 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:29.498602 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80bb29cb-0a3a-449d-8ebb-7044a41fa261 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:29.499048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80bb29cb-0a3a-449d-8ebb-7044a41fa261 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:29.499771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80bb29cb-0a3a-449d-8ebb-7044a41fa261 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:29.500233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80bb29cb-0a3a-449d-8ebb-7044a41fa261 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:29.500663 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80bb29cb-0a3a-449d-8ebb-7044a41fa261 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:29.541277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8b7d7776-856a-4d35-a47d-a70839a6a760 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:29.542177 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8b7d7776-856a-4d35-a47d-a70839a6a760 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:29.548494 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7d7776-856a-4d35-a47d-a70839a6a760 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:29.548979 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7d7776-856a-4d35-a47d-a70839a6a760 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:29.549418 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7d7776-856a-4d35-a47d-a70839a6a760 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:29.550114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7d7776-856a-4d35-a47d-a70839a6a760 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:29.550569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7d7776-856a-4d35-a47d-a70839a6a760 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:29.550992 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7d7776-856a-4d35-a47d-a70839a6a760 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:29.562950 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-80bb29cb-0a3a-449d-8ebb-7044a41fa261 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:29.571400 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-80bb29cb-0a3a-449d-8ebb-7044a41fa261 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1303 microversion: 2.1 time: 0.084537 Sep 19 17:28:29.572010 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 298/596] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:29 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:29.687559 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8b7d7776-856a-4d35-a47d-a70839a6a760 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:29.696171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8b7d7776-856a-4d35-a47d-a70839a6a760 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.159081 Sep 19 17:28:29.696679 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 299/597] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:29 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:28:29.766577 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:29.767282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:29.773705 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:29.774187 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:29.774627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:29.775317 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:29.775799 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:29.776234 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:29.903318 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:29.911348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:29.912810 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:29.913966 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e18338e8-d191-4aca-b662-2801b1a043d0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.151617 Sep 19 17:28:29.914531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 299/598] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:29 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:30.594472 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:30.595077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:30.601598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:30.602078 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:30.602512 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:30.603191 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:30.603640 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:30.604101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:30.608252 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:30.636473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:30.636868 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:30.637302 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:30.637742 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lazy-loading 'fault' on Instance uuid 32db63e3-5981-4b3d-b998-d41a91dd16db {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:28:30.676864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:30.685296 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c75eb117-a2e1-41b3-8e24-8ed5de0b552c tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1308 microversion: 2.1 time: 0.094695 Sep 19 17:28:30.685847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 300/599] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:30 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:30.718973 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ffaa971-7430-4e62-bff1-75b978a4aaed tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:30.719722 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5ffaa971-7430-4e62-bff1-75b978a4aaed tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:30.727932 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ffaa971-7430-4e62-bff1-75b978a4aaed tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:30.728430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ffaa971-7430-4e62-bff1-75b978a4aaed tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:30.728865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ffaa971-7430-4e62-bff1-75b978a4aaed tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:30.729578 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ffaa971-7430-4e62-bff1-75b978a4aaed tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:30.730037 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ffaa971-7430-4e62-bff1-75b978a4aaed tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:30.730458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ffaa971-7430-4e62-bff1-75b978a4aaed tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:30.868076 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5ffaa971-7430-4e62-bff1-75b978a4aaed tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:30.875803 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5ffaa971-7430-4e62-bff1-75b978a4aaed tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1260 microversion: 2.1 time: 0.160702 Sep 19 17:28:30.876372 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 300/600] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:30 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:30.939624 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:30.940222 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:30.946323 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:30.946811 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:30.947245 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:30.947976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:30.948484 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:30.948996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:31.092982 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:31.101832 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:31.103335 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:31.104512 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e800856e-a520-4091-ad0d-fb819b60bf08 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1738 microversion: 2.20 time: 0.168877 Sep 19 17:28:31.105068 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 301/601] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:30 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:31.767394 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:31.768314 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:31.774794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:31.775281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:31.775741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:31.776665 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:31.776945 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:31.777367 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:31.811994 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:31.812893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:31.813354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:31.813841 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lazy-loading 'fault' on Instance uuid 32db63e3-5981-4b3d-b998-d41a91dd16db {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:28:31.859959 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a2c7317c61405e8c9e9118286be69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6198c6cbed294d0eb4ef8fcd97ba96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:31.868062 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-80169573-0152-4599-a388-fe6bb1bf6c4d tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 200 len: 1308 microversion: 2.1 time: 0.104662 Sep 19 17:28:31.868587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 301/602] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:31 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:31.900986 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-caa01eb2-84f2-43a8-8932-55a4cf9d3244 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:31.901612 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-caa01eb2-84f2-43a8-8932-55a4cf9d3244 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:31.904437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=66 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:31.909601 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-caa01eb2-84f2-43a8-8932-55a4cf9d3244 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:31.910383 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-caa01eb2-84f2-43a8-8932-55a4cf9d3244 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:31.910831 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-caa01eb2-84f2-43a8-8932-55a4cf9d3244 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:31.911555 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-caa01eb2-84f2-43a8-8932-55a4cf9d3244 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:31.912049 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-caa01eb2-84f2-43a8-8932-55a4cf9d3244 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:31.913096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-caa01eb2-84f2-43a8-8932-55a4cf9d3244 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:32.070059 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-caa01eb2-84f2-43a8-8932-55a4cf9d3244 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:32.080509 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-caa01eb2-84f2-43a8-8932-55a4cf9d3244 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1444 microversion: 2.1 time: 0.184177 Sep 19 17:28:32.081078 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 302/603] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:31 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1444 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:32.104122 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9e2f3a6f-2799-41b4-900b-2fd4a2bbffeb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:32.104733 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9e2f3a6f-2799-41b4-900b-2fd4a2bbffeb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:32.110687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e2f3a6f-2799-41b4-900b-2fd4a2bbffeb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:32.111167 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e2f3a6f-2799-41b4-900b-2fd4a2bbffeb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:32.111602 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e2f3a6f-2799-41b4-900b-2fd4a2bbffeb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:32.112311 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e2f3a6f-2799-41b4-900b-2fd4a2bbffeb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:32.112764 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e2f3a6f-2799-41b4-900b-2fd4a2bbffeb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:32.113185 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e2f3a6f-2799-41b4-900b-2fd4a2bbffeb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:32.129868 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:32.130394 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:32.136862 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:32.137337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:32.137770 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:32.138463 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:32.138914 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:32.139335 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:32.315446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9e2f3a6f-2799-41b4-900b-2fd4a2bbffeb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:32.321461 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:32.324603 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9e2f3a6f-2799-41b4-900b-2fd4a2bbffeb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1444 microversion: 2.1 time: 0.224858 Sep 19 17:28:32.325437 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 302/604] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:32 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1444 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:28:32.330763 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:32.332337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:32.333539 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-779d6856-c262-42d9-8b3a-ec5e81ae5f1b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1720 microversion: 2.20 time: 0.207567 Sep 19 17:28:32.334097 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 303/605] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:32 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:28:32.890858 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:32.891467 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] [instance: 32db63e3-5981-4b3d-b998-d41a91dd16db] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:32.899142 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:32.899899 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:32.900396 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:32.901052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:32.901504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:32.901927 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:32.918055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] HTTP exception thrown: Instance 32db63e3-5981-4b3d-b998-d41a91dd16db could not be found. Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Request method failure captured: Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db HTTP/1.1 Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKXl4mS5escdT69lsiyURoJPLhJfAFDIyiUXOUKexr2h48t_7I-726hxAn9DrDCjf2dstZso9y-CdBKPIaFFgNcNhN1I1mZZ1jBn4oUA3fiLKqbaBJxq5czFBskJ33YTE_aVBXDEAB4IfV7rvwH6jf7XDYfs2Xtx-IUcqctgH_lJJPg Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 6198c6cbed294d0eb4ef8fcd97ba96fe Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesSnapshotTestJSON-405652299 Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:28:32.919741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6198c6cbed294d0eb4ef8fcd97ba96fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6198c6cbed294d0eb4ef8fcd97ba96fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6198c6cbed294d0eb4ef8fcd97ba96fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6198c6cbed294d0eb4ef8fcd97ba96fe"}]}] Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-VolumesSnapshotTestJSON-405652299 Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 6198c6cbed294d0eb4ef8fcd97ba96fe Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-405652299 Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-VolumesSnapshotTestJSON-405652299-project Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 74a2c7317c61405e8c9e9118286be69d Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-VolumesSnapshotTestJSON-405652299-project Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 32db63e3-5981-4b3d-b998-d41a91dd16db could not be found. Sep 19 17:28:32.921132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '32db63e3-5981-4b3d-b998-d41a91dd16db'} Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32db63e3-5981-4b3d-b998-d41a91dd16db could not be found. Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:28:32.921968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32db63e3-5981-4b3d-b998-d41a91dd16db could not be found. Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32db63e3-5981-4b3d-b998-d41a91dd16db could not be found. Sep 19 17:28:32.923554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:28:32.924830 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] Returning 404 to user: Instance 32db63e3-5981-4b3d-b998-d41a91dd16db could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:28:32.924830 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f4d05eb-c063-4a01-a0c1-67e81fa59275 tempest-VolumesSnapshotTestJSON-405652299 tempest-VolumesSnapshotTestJSON-405652299-project] 10.222.0.61 "GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db" status: 404 len: 111 microversion: 2.1 time: 0.034275 Sep 19 17:28:32.924830 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 303/606] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:28:32 2022] GET /compute/v2.1/servers/32db63e3-5981-4b3d-b998-d41a91dd16db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:28:33.361583 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:33.363029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:33.370185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:33.370823 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:33.371345 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:33.372198 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:33.372975 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:33.373531 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:33.512240 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:33.523302 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:33.525173 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:33.526141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-43b3910e-d480-4378-ad84-210631886146 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1720 microversion: 2.20 time: 0.169357 Sep 19 17:28:33.535825 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 304/607] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:33 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:33.703058 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-4324734f-34b3-4d18-9db5-bade5ecda3e0 req-aca8af52-3637-450f-bd1e-6a3b1ce28186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2eb485-3b5a-4326-bd4f-9029da4e6744", "name": "network-vif-unplugged", "status": "completed", "tag": "e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:28:33.714628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4324734f-34b3-4d18-9db5-bade5ecda3e0 req-aca8af52-3637-450f-bd1e-6a3b1ce28186 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:33.715130 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4324734f-34b3-4d18-9db5-bade5ecda3e0 req-aca8af52-3637-450f-bd1e-6a3b1ce28186 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:33.715566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4324734f-34b3-4d18-9db5-bade5ecda3e0 req-aca8af52-3637-450f-bd1e-6a3b1ce28186 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:33.727490 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-4324734f-34b3-4d18-9db5-bade5ecda3e0 req-aca8af52-3637-450f-bd1e-6a3b1ce28186 service nova] Creating event network-vif-unplugged:e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43 for instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 on hv-cinder-84801 Sep 19 17:28:33.732678 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-4324734f-34b3-4d18-9db5-bade5ecda3e0 req-aca8af52-3637-450f-bd1e-6a3b1ce28186 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033965 Sep 19 17:28:33.733274 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 304/608] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:28:34.355314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-96882d31-a478-4d3d-aaa5-0f10072d6e84 req-c10f5a06-e7a5-4d82-922f-ea03f91fb221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9442149d-db6c-4fd9-b92a-3eaf3e8c2046", "tag": "ddae7d4a-71c6-4777-a374-39594620566f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:28:34.366035 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96882d31-a478-4d3d-aaa5-0f10072d6e84 req-c10f5a06-e7a5-4d82-922f-ea03f91fb221 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:34.366609 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96882d31-a478-4d3d-aaa5-0f10072d6e84 req-c10f5a06-e7a5-4d82-922f-ea03f91fb221 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:34.366965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96882d31-a478-4d3d-aaa5-0f10072d6e84 req-c10f5a06-e7a5-4d82-922f-ea03f91fb221 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:34.379346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-96882d31-a478-4d3d-aaa5-0f10072d6e84 req-c10f5a06-e7a5-4d82-922f-ea03f91fb221 service nova] Creating event network-changed:ddae7d4a-71c6-4777-a374-39594620566f for instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 on hv-cinder-84801 Sep 19 17:28:34.385206 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-96882d31-a478-4d3d-aaa5-0f10072d6e84 req-c10f5a06-e7a5-4d82-922f-ea03f91fb221 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033509 Sep 19 17:28:34.385779 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 305/609] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:28:34.554577 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:34.555315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:34.561627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:34.562116 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:34.562560 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:34.563278 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:34.563762 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:34.564194 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:34.725672 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:34.734598 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:34.736402 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:34.737803 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ece8dda-44f8-40cd-9111-3178414df9e1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1720 microversion: 2.20 time: 0.188578 Sep 19 17:28:34.738459 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 305/610] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:34 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:35.766489 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:35.767184 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:35.773947 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:35.774526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:35.775004 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:35.776133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:35.776593 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:35.777347 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:35.915225 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:35.923952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:35.925404 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:35.926650 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-779175dd-05bf-4b2b-b1e5-c7b73186d56c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1723 microversion: 2.20 time: 0.165005 Sep 19 17:28:35.946700 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 306/611] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:35 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:35.954202 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57050f96-3740-4efa-a8df-a5bc31676e9b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8921c8f2-b47c-403f-9a01-547ac6d26825"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:28:35.963326 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-57050f96-3740-4efa-a8df-a5bc31676e9b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:35.963573 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57050f96-3740-4efa-a8df-a5bc31676e9b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:35.964087 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57050f96-3740-4efa-a8df-a5bc31676e9b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:35.964521 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57050f96-3740-4efa-a8df-a5bc31676e9b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:35.965216 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57050f96-3740-4efa-a8df-a5bc31676e9b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:35.965665 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57050f96-3740-4efa-a8df-a5bc31676e9b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:35.966092 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57050f96-3740-4efa-a8df-a5bc31676e9b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:37.055416 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-57050f96-3740-4efa-a8df-a5bc31676e9b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "POST /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.105116 Sep 19 17:28:37.056215 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 306/612] 10.222.0.61 () {62 vars in 1364 bytes} [Mon Sep 19 17:28:35 2022] POST /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments => generated 188 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:28:37.192710 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77ef5800-b352-49ff-b990-15330272b9ca tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:28:37.193336 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77ef5800-b352-49ff-b990-15330272b9ca tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:37.199633 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77ef5800-b352-49ff-b990-15330272b9ca tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:37.200155 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77ef5800-b352-49ff-b990-15330272b9ca tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:37.200594 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77ef5800-b352-49ff-b990-15330272b9ca tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:37.201331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77ef5800-b352-49ff-b990-15330272b9ca tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:37.201785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77ef5800-b352-49ff-b990-15330272b9ca tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:37.202217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77ef5800-b352-49ff-b990-15330272b9ca tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:37.296374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77ef5800-b352-49ff-b990-15330272b9ca tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121135) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 17:28:37.601482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77ef5800-b352-49ff-b990-15330272b9ca tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "POST /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/action" status: 202 len: 0 microversion: 2.20 time: 0.412136 Sep 19 17:28:37.601482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 307/613] 10.222.0.61 () {62 vars in 1319 bytes} [Mon Sep 19 17:28:37 2022] POST /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:28:37.610469 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:37.611111 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:37.618055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:37.618469 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:37.618912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:37.619621 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:37.620125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:37.620559 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:37.760047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:37.775262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:37.776024 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:37.777244 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19796085-7ba4-4189-a739-d8ae035534ee tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1749 microversion: 2.20 time: 0.171512 Sep 19 17:28:37.777890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 307/614] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:37 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:38.810843 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:38.811628 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:38.818018 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:38.819074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:38.819519 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:38.820247 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:38.820705 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:38.821136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:38.963232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:38.971872 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:38.975080 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:38.975080 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-124b65a1-e1fa-4e39-82e8-f150d2e442db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1749 microversion: 2.20 time: 0.167736 Sep 19 17:28:38.975591 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 308/615] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:38 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:40.000540 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:40.001259 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:40.008492 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:40.008983 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:40.009429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:40.010123 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:40.010581 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:40.011010 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:40.141626 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:40.150790 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:40.152252 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:40.153421 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1e9a3e8-2a86-466b-98b7-7d34c1912cda tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1749 microversion: 2.20 time: 0.156961 Sep 19 17:28:40.153971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 308/616] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:39 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:41.178522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:41.179765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:41.186439 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:41.186927 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:41.187365 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:41.188086 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:41.188542 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:41.188968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:41.318112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:41.327453 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:41.331370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:41.331370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-984e1bb8-aca7-47e7-bbcb-fe3fb3cd9901 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1751 microversion: 2.20 time: 0.155627 Sep 19 17:28:41.331370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 309/617] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:41 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:42.356970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:42.357610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:42.360310 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:42.365484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:42.365999 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:42.366484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:42.367329 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:42.367827 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:42.368304 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:42.511632 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:42.520664 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:42.522107 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:42.523782 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-673c68a8-b72f-4699-90cd-c89f6d57dfd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1751 microversion: 2.20 time: 0.170678 Sep 19 17:28:42.524397 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 309/618] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:42 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:28:43.548969 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:43.549583 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:43.557283 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:43.557603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:43.558044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:43.558747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:43.559202 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:43.559627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:43.694239 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:43.703216 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:43.704804 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:43.706157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-07ca2ef4-30b0-4671-a911-63215f53a6b4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.161079 Sep 19 17:28:43.706900 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 310/619] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:43 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:44.732576 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:44.733402 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:44.739924 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:44.740675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:44.741345 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:44.742307 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:44.742728 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:44.743156 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:44.904292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:44.913900 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:44.915333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:44.916538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a95d322-ee02-46e7-ae34-56420cb88e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.187904 Sep 19 17:28:44.917098 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 310/620] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:44 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:45.942791 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:45.943394 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:45.950436 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:45.950928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:45.951360 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:45.952193 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:45.952676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:45.953103 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:46.102057 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:46.113100 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:46.114614 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:46.119854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9f683c3d-cde1-4c7d-9115-7cd396ae2455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.176848 Sep 19 17:28:46.119854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 311/621] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:45 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:47.142189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:47.143047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:47.149938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:47.150425 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:47.150868 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:47.151602 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:47.152099 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:47.152526 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:47.172474 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:47.283531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:47.292805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:47.294293 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:47.295492 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f6e1177a-0207-4d2a-b403-7aaabd71bcc8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.157490 Sep 19 17:28:47.296235 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 311/622] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:47 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:48.323323 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:48.324600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:48.333569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:48.334130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:48.334788 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:48.335577 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:48.336297 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:48.336918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:48.481103 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:48.490220 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:48.491657 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:48.494631 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-38d7ac1d-8a46-478b-947e-55cae1c1b19e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.174814 Sep 19 17:28:48.500575 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 312/623] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:48 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:49.518807 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:49.519411 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:49.526934 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:49.527411 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:49.527879 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:49.528574 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:49.529061 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:49.529482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:49.675588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:49.686780 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:49.688865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:49.690834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6ca6d358-f8f8-416e-82de-89e8c92d88f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.175903 Sep 19 17:28:49.700375 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 312/624] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:49 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:50.718102 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:50.718677 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:50.725033 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:50.725521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:50.725966 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:50.726661 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:50.727268 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:50.727553 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:50.871212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:50.879653 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:50.881087 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:50.882235 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0667a589-3195-41cd-9df7-a0ec238d93f3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.168197 Sep 19 17:28:50.882792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 313/625] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:50 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:51.909274 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:51.910998 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:51.920626 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:51.921573 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:51.922258 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:51.923214 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:51.923918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:51.924590 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:52.060863 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:52.070018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:52.071495 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:52.072712 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d6b55286-ec94-4ff8-9745-0b70af79c84c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.167729 Sep 19 17:28:52.073538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 313/626] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:51 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:53.099209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:53.100870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:53.108831 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:53.109796 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:53.110286 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:53.111141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:53.111141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:53.111141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:53.255390 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:53.264659 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:53.266105 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:53.267268 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f006be7a-f7e4-44ee-a9f5-ad953c45afac tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.172755 Sep 19 17:28:53.268138 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 314/627] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:53 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:28:54.293786 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:54.294328 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:54.300979 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:54.301797 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:54.302038 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:54.302603 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:54.303057 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:54.303474 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:54.634166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:54.642937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:54.644431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:54.645576 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e98587ec-5fea-4dee-995e-4c5008f4a628 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.355891 Sep 19 17:28:54.646127 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 314/628] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:54 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:55.671318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:55.671935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:55.678660 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:55.679146 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:55.679581 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:55.680890 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:55.681354 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:55.681784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:55.811803 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7887fb3d-7f41-4b84-8ecf-d5ebfd4ce8ad tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:55.813007 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7887fb3d-7f41-4b84-8ecf-d5ebfd4ce8ad tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:55.819500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7887fb3d-7f41-4b84-8ecf-d5ebfd4ce8ad tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:55.820025 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7887fb3d-7f41-4b84-8ecf-d5ebfd4ce8ad tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:55.820588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7887fb3d-7f41-4b84-8ecf-d5ebfd4ce8ad tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:55.821340 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7887fb3d-7f41-4b84-8ecf-d5ebfd4ce8ad tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:55.821812 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7887fb3d-7f41-4b84-8ecf-d5ebfd4ce8ad tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:55.822235 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7887fb3d-7f41-4b84-8ecf-d5ebfd4ce8ad tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:55.823975 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:55.832721 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:55.834152 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:55.835313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ef3fc732-3008-432b-93d5-7fe7bdfbd27a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.167984 Sep 19 17:28:55.836059 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 315/629] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:55 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:55.849606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7887fb3d-7f41-4b84-8ecf-d5ebfd4ce8ad tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/ips" status: 200 len: 147 microversion: 2.1 time: 0.041724 Sep 19 17:28:55.850171 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 315/630] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Sep 19 17:28:55 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:28:56.866104 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:56.866731 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:56.881482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:56.881482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:56.881482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:56.881482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:56.882135 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:56.882135 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:56.899073 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:28:57.026814 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:57.036081 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:57.037623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:57.038801 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-37b7a9d4-5e5b-4d12-a971-73327bf7688a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.177676 Sep 19 17:28:57.039894 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 316/631] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:56 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:58.065515 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:58.066133 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:58.073126 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:58.073608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:58.074045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:58.074851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:58.075343 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:58.075795 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:58.207365 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:58.237462 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:58.239608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:58.241282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6fc3f2cd-874c-4275-ab9d-a7501c0d8ecd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.179583 Sep 19 17:28:58.243176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 316/632] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:58 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:28:59.270695 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:28:59.271309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:28:59.278576 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:59.279050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:59.279486 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:59.280206 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:28:59.280660 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:28:59.281084 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:28:59.415657 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:59.425896 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:59.427667 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:28:59.429477 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2a84d19e-88fe-471d-bde5-9281d80b6e14 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.163303 Sep 19 17:28:59.440432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 317/633] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:28:59 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:00.401431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b673e2ee-7c11-4c97-bbff-08450e969e3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97805e51-5bbc-45b6-9196-1b1b21baf073"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:29:00.403860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b673e2ee-7c11-4c97-bbff-08450e969e3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:00.410288 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b673e2ee-7c11-4c97-bbff-08450e969e3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:00.410774 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b673e2ee-7c11-4c97-bbff-08450e969e3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:00.411214 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b673e2ee-7c11-4c97-bbff-08450e969e3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:00.411936 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b673e2ee-7c11-4c97-bbff-08450e969e3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:00.412426 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b673e2ee-7c11-4c97-bbff-08450e969e3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:00.412856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b673e2ee-7c11-4c97-bbff-08450e969e3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:00.456520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:00.457133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:00.464180 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:00.464664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:00.465108 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:00.465803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:00.466254 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:00.466766 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:00.610785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:00.619459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:00.621000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:00.622160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-54114f92-dbb4-4141-a949-d3ec329a0c12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.169570 Sep 19 17:29:00.622805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 318/634] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:00 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:29:01.648068 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:01.648721 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:01.654975 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:01.655456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:01.655928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:01.656626 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:01.657081 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:01.657508 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:01.793302 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:01.802027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:01.803456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:01.804682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73bc76a4-a851-4493-baff-5a9b7f1d3ae7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.160635 Sep 19 17:29:01.805242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 319/635] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:01 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:29:02.829505 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:02.830189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:02.832413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:29:02.837101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:02.843618 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:02.843618 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:02.843618 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:02.843618 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:02.844015 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:02.974888 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:02.983978 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:02.985396 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:02.986619 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ecfa7442-b1aa-46ae-807c-155030c3c60d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.160995 Sep 19 17:29:02.987099 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 320/636] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:02 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:29:04.013305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:04.013979 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:04.020641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:04.021379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:04.021554 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:04.022257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:04.022714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:04.023142 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:04.153490 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:04.162188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:04.163559 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:04.164637 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86f8b36e-df1e-4468-8203-6ca86d7858cf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.155365 Sep 19 17:29:04.165468 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 321/637] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:04 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:29:05.194212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:05.194891 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:05.201090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:05.201565 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:05.208451 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:05.208451 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:05.208451 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:05.208451 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:05.232185 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b673e2ee-7c11-4c97-bbff-08450e969e3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "POST /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.834787 Sep 19 17:29:05.233188 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 317/638] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:29:00 2022] POST /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/os-volume_attachments => generated 194 bytes in 4837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:29:05.354651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:05.368794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:05.370321 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:05.371747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bc729396-2b57-4c22-957f-f23989508708 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.181486 Sep 19 17:29:05.372312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 322/639] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:05 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:06.399642 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:06.400373 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:06.407139 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:06.407949 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:06.408290 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:06.408996 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:06.409458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:06.409888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:06.542658 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:06.550157 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:06.551615 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:06.552817 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-37e5916c-6311-4a37-8e6e-a8f58e1d309b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.157589 Sep 19 17:29:06.553374 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 318/640] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:06 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:07.580467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:07.581012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:07.587043 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:07.587528 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:07.588586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:07.589289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:07.589748 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:07.590183 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:07.718923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:07.726500 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:07.733476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:07.733476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-838364ed-cc03-402f-ab51-16c855522d7a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.152847 Sep 19 17:29:07.733476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 323/641] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:07 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:08.754658 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:08.755893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:08.762441 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:08.762853 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:08.763289 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:08.764025 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:08.764538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:08.765033 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:09.014301 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:09.023715 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:09.025203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:09.026372 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-65f7573f-114f-4ebc-a86d-12068aa6a5d2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.275716 Sep 19 17:29:09.026927 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 319/642] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:08 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:10.056088 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:10.057232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:10.064056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:10.064674 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:10.065128 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:10.065866 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:10.066332 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:10.066763 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:10.203286 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:10.212635 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:10.214077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:10.215260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-52c36c1f-09d1-4d5f-82e4-a2d251bfa308 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.164969 Sep 19 17:29:10.216212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 324/643] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:10 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:11.242563 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:11.243427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:11.250624 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:11.251336 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:11.251796 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:11.252684 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:11.253144 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:11.253606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:11.393027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:11.406904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:11.408456 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:11.409650 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-59a9e59e-c894-486d-95b3-450bdf9bc0b9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.171589 Sep 19 17:29:11.410225 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 320/644] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:11 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:29:12.437042 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:12.438115 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:12.449107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:12.450346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:12.451077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:12.452343 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:12.452823 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:12.453296 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:12.673462 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:12.691399 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:12.693730 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:12.696322 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aafc887a-8b57-4847-8c20-a5091222e02d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.264871 Sep 19 17:29:12.697553 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 325/645] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:12 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:13.728507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:13.730533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:13.741742 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=24 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:29:13.743575 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:13.749788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:13.749788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:13.749788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:13.749788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:13.750197 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:13.919106 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-34bda9a2-1e8c-4f8f-9ca5-47614272835c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:29:13.927005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:13.928287 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34bda9a2-1e8c-4f8f-9ca5-47614272835c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:13.929031 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34bda9a2-1e8c-4f8f-9ca5-47614272835c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:13.929696 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34bda9a2-1e8c-4f8f-9ca5-47614272835c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:13.939100 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:13.941324 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:13.942925 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-55a6de45-992c-469d-b033-24e0bafbf15c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.220194 Sep 19 17:29:13.948238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 321/646] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:13 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:14.007066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-34bda9a2-1e8c-4f8f-9ca5-47614272835c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Going to try to stop instance {{(pid=121135) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 17:29:14.194664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-34bda9a2-1e8c-4f8f-9ca5-47614272835c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "POST /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/action" status: 202 len: 0 microversion: 2.1 time: 0.271610 Sep 19 17:29:14.194664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 326/647] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:29:13 2022] POST /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:29:14.194988 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a0d84a88-971e-488e-a039-bef465cd50a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:14.195664 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a0d84a88-971e-488e-a039-bef465cd50a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:14.205986 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0d84a88-971e-488e-a039-bef465cd50a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:14.206487 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0d84a88-971e-488e-a039-bef465cd50a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:14.206928 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0d84a88-971e-488e-a039-bef465cd50a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:14.207644 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0d84a88-971e-488e-a039-bef465cd50a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:14.208924 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0d84a88-971e-488e-a039-bef465cd50a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:14.209370 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0d84a88-971e-488e-a039-bef465cd50a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:14.374068 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a0d84a88-971e-488e-a039-bef465cd50a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:14.383968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a0d84a88-971e-488e-a039-bef465cd50a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1724 microversion: 2.1 time: 0.193022 Sep 19 17:29:14.385518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 322/648] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:14 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:14.971462 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:14.972548 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:14.979613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:14.980263 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:14.980807 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:14.981806 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:14.982481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:14.983137 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:15.130077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:15.139623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:15.141159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:15.142888 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bbddb9d4-19b3-420c-821e-3690326709ab tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.176192 Sep 19 17:29:15.144282 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 327/649] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:14 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:15.367873 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-63d93e21-7a7c-417b-8709-a154809c8b80 req-f29cf379-0035-41dd-983a-163ca290b9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2eb485-3b5a-4326-bd4f-9029da4e6744", "name": "network-vif-plugged", "status": "completed", "tag": "e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:29:15.379009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-63d93e21-7a7c-417b-8709-a154809c8b80 req-f29cf379-0035-41dd-983a-163ca290b9f6 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:15.379448 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-63d93e21-7a7c-417b-8709-a154809c8b80 req-f29cf379-0035-41dd-983a-163ca290b9f6 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:15.379799 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-63d93e21-7a7c-417b-8709-a154809c8b80 req-f29cf379-0035-41dd-983a-163ca290b9f6 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:15.394809 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-63d93e21-7a7c-417b-8709-a154809c8b80 req-f29cf379-0035-41dd-983a-163ca290b9f6 service nova] Creating event network-vif-plugged:e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43 for instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 on hv-cinder-84801 Sep 19 17:29:15.400297 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-63d93e21-7a7c-417b-8709-a154809c8b80 req-f29cf379-0035-41dd-983a-163ca290b9f6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177933 Sep 19 17:29:15.400987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 323/650] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:29:15.414547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f7935676-433c-477f-aada-be198b5c6b52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:15.421712 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f7935676-433c-477f-aada-be198b5c6b52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:15.431996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7935676-433c-477f-aada-be198b5c6b52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:15.434626 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7935676-433c-477f-aada-be198b5c6b52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:15.434626 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7935676-433c-477f-aada-be198b5c6b52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:15.435739 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7935676-433c-477f-aada-be198b5c6b52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:15.436339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7935676-433c-477f-aada-be198b5c6b52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:15.437136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7935676-433c-477f-aada-be198b5c6b52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:15.638251 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f7935676-433c-477f-aada-be198b5c6b52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:15.647465 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f7935676-433c-477f-aada-be198b5c6b52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1724 microversion: 2.1 time: 0.242978 Sep 19 17:29:15.648086 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 328/651] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:15 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:16.173225 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:16.184932 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:16.184932 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:16.189416 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:16.190074 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:16.190999 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:16.191621 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:16.192289 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:16.445553 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:16.455672 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:16.458709 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:16.460384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-578a5759-faf1-4c62-924f-23908416751c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.294685 Sep 19 17:29:16.461126 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 324/652] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:16 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:16.670309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2b3b838-4fbc-4e84-b4cc-0aea8b790d41 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:16.670942 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d2b3b838-4fbc-4e84-b4cc-0aea8b790d41 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:16.677737 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b3b838-4fbc-4e84-b4cc-0aea8b790d41 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:16.678233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b3b838-4fbc-4e84-b4cc-0aea8b790d41 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:16.678679 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b3b838-4fbc-4e84-b4cc-0aea8b790d41 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:16.679398 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b3b838-4fbc-4e84-b4cc-0aea8b790d41 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:16.679920 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b3b838-4fbc-4e84-b4cc-0aea8b790d41 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:16.680353 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b3b838-4fbc-4e84-b4cc-0aea8b790d41 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:16.826932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d2b3b838-4fbc-4e84-b4cc-0aea8b790d41 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:16.836344 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d2b3b838-4fbc-4e84-b4cc-0aea8b790d41 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1724 microversion: 2.1 time: 0.169896 Sep 19 17:29:16.848071 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 329/653] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:16 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:17.487303 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:17.488003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:17.495516 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:17.496034 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:17.496473 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:17.497173 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:17.497628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:17.498055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:17.704949 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:17.714097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:17.715638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:17.716852 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-30950a8a-11eb-4357-bc21-8fbd15afdc38 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.233569 Sep 19 17:29:17.717599 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 325/654] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:17 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:17.863023 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-49a6b2bb-58bf-42d2-a111-4b96d632ef62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:17.864352 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-49a6b2bb-58bf-42d2-a111-4b96d632ef62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:17.878042 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a6b2bb-58bf-42d2-a111-4b96d632ef62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:17.878808 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a6b2bb-58bf-42d2-a111-4b96d632ef62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:17.879583 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a6b2bb-58bf-42d2-a111-4b96d632ef62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:17.880725 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a6b2bb-58bf-42d2-a111-4b96d632ef62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:17.881404 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a6b2bb-58bf-42d2-a111-4b96d632ef62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:17.882068 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a6b2bb-58bf-42d2-a111-4b96d632ef62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:18.105899 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-49a6b2bb-58bf-42d2-a111-4b96d632ef62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:18.123761 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-49a6b2bb-58bf-42d2-a111-4b96d632ef62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1724 microversion: 2.1 time: 0.263864 Sep 19 17:29:18.124679 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 330/655] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:17 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:18.743594 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:18.744370 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:18.756194 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:18.760435 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:18.761121 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:18.762006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:18.762736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:18.763504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:18.979166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:18.981779 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:18.983657 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:18.985266 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76af78b7-018f-4a98-b8cb-ca48e043b896 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.246748 Sep 19 17:29:18.986453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 326/656] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:18 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:19.147020 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-893cdb18-2a6e-433b-bbef-45bf19c54d4d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:19.147741 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-893cdb18-2a6e-433b-bbef-45bf19c54d4d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:19.168976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893cdb18-2a6e-433b-bbef-45bf19c54d4d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:19.169704 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893cdb18-2a6e-433b-bbef-45bf19c54d4d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:19.170435 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893cdb18-2a6e-433b-bbef-45bf19c54d4d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:19.172041 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893cdb18-2a6e-433b-bbef-45bf19c54d4d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:19.173167 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893cdb18-2a6e-433b-bbef-45bf19c54d4d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:19.173825 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893cdb18-2a6e-433b-bbef-45bf19c54d4d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:19.357962 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-893cdb18-2a6e-433b-bbef-45bf19c54d4d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:19.362289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:29:19.377419 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-893cdb18-2a6e-433b-bbef-45bf19c54d4d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1724 microversion: 2.1 time: 0.234273 Sep 19 17:29:19.378046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 331/657] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:19 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:20.019235 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:20.019883 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:20.032574 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:20.033283 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:20.035316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:20.036391 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:20.037081 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:20.037877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:20.095937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:29:20.329895 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:20.339581 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:20.341066 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:20.342263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-55be27a9-2796-421a-b80d-0e8a11d87814 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1807 microversion: 2.20 time: 0.333487 Sep 19 17:29:20.342898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 327/658] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:20 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1807 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:20.404509 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3b149c32-7fb4-4dfc-9eda-157590f6834f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:20.412409 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3b149c32-7fb4-4dfc-9eda-157590f6834f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:20.430312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b149c32-7fb4-4dfc-9eda-157590f6834f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:20.430816 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b149c32-7fb4-4dfc-9eda-157590f6834f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:20.431830 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b149c32-7fb4-4dfc-9eda-157590f6834f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:20.432554 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b149c32-7fb4-4dfc-9eda-157590f6834f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:20.433009 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b149c32-7fb4-4dfc-9eda-157590f6834f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:20.433437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b149c32-7fb4-4dfc-9eda-157590f6834f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:20.636794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3b149c32-7fb4-4dfc-9eda-157590f6834f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:20.648303 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3b149c32-7fb4-4dfc-9eda-157590f6834f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1724 microversion: 2.1 time: 0.250052 Sep 19 17:29:20.657712 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 332/659] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:20 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:21.370298 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:21.370916 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:21.378494 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:21.378990 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:21.379438 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:21.380198 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:21.380657 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:21.381084 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:21.605616 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:21.614878 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:21.616334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:21.617528 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-67460420-c9a7-4600-8aac-55454406f113 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1794 microversion: 2.20 time: 0.251251 Sep 19 17:29:21.631723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 328/660] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:29:21 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1794 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:29:21.673032 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-03435e39-95df-43cb-8895-3a6e156caa05 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:21.673653 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-03435e39-95df-43cb-8895-3a6e156caa05 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:21.680676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03435e39-95df-43cb-8895-3a6e156caa05 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:21.681329 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03435e39-95df-43cb-8895-3a6e156caa05 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:21.681769 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03435e39-95df-43cb-8895-3a6e156caa05 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:21.682651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03435e39-95df-43cb-8895-3a6e156caa05 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:21.683410 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03435e39-95df-43cb-8895-3a6e156caa05 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:21.684090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03435e39-95df-43cb-8895-3a6e156caa05 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:21.886759 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-03435e39-95df-43cb-8895-3a6e156caa05 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:21.896881 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-03435e39-95df-43cb-8895-3a6e156caa05 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1724 microversion: 2.1 time: 0.228078 Sep 19 17:29:21.897466 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 333/661] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:21 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:22.922897 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-358dfd1e-3a22-4cee-bb22-ab5cebe4e3a8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:22.924157 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-358dfd1e-3a22-4cee-bb22-ab5cebe4e3a8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:22.930787 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358dfd1e-3a22-4cee-bb22-ab5cebe4e3a8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:22.931419 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358dfd1e-3a22-4cee-bb22-ab5cebe4e3a8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:22.931836 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358dfd1e-3a22-4cee-bb22-ab5cebe4e3a8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:22.932550 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358dfd1e-3a22-4cee-bb22-ab5cebe4e3a8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:22.933009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358dfd1e-3a22-4cee-bb22-ab5cebe4e3a8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:22.933432 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358dfd1e-3a22-4cee-bb22-ab5cebe4e3a8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:23.187889 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-358dfd1e-3a22-4cee-bb22-ab5cebe4e3a8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:23.197594 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-358dfd1e-3a22-4cee-bb22-ab5cebe4e3a8 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1724 microversion: 2.1 time: 0.278086 Sep 19 17:29:23.198256 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 329/662] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:22 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:24.240514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2baacf7-a9fb-4b4e-8126-ed99800b427b tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:24.240514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a2baacf7-a9fb-4b4e-8126-ed99800b427b tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:24.240514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2baacf7-a9fb-4b4e-8126-ed99800b427b tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:24.240514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2baacf7-a9fb-4b4e-8126-ed99800b427b tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:24.241651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2baacf7-a9fb-4b4e-8126-ed99800b427b tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:24.241651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2baacf7-a9fb-4b4e-8126-ed99800b427b tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:24.241651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2baacf7-a9fb-4b4e-8126-ed99800b427b tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:24.241651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2baacf7-a9fb-4b4e-8126-ed99800b427b tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:24.376157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a2baacf7-a9fb-4b4e-8126-ed99800b427b tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:24.396681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a2baacf7-a9fb-4b4e-8126-ed99800b427b tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1724 microversion: 2.1 time: 0.167566 Sep 19 17:29:24.396681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 334/663] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:24 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:25.414671 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af62f64a-a58f-4bbd-82fe-a4e3242013ec tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:25.416607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af62f64a-a58f-4bbd-82fe-a4e3242013ec tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:25.437213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af62f64a-a58f-4bbd-82fe-a4e3242013ec tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:25.437731 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af62f64a-a58f-4bbd-82fe-a4e3242013ec tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:25.439896 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af62f64a-a58f-4bbd-82fe-a4e3242013ec tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:25.441630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af62f64a-a58f-4bbd-82fe-a4e3242013ec tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:25.442496 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af62f64a-a58f-4bbd-82fe-a4e3242013ec tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:25.443199 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af62f64a-a58f-4bbd-82fe-a4e3242013ec tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:25.622686 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-af62f64a-a58f-4bbd-82fe-a4e3242013ec tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:25.631581 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af62f64a-a58f-4bbd-82fe-a4e3242013ec tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1701 microversion: 2.1 time: 0.221291 Sep 19 17:29:25.633266 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 330/664] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:25 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1701 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:25.655854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04d45dee-06ac-4e3e-99e8-fb7306cc7fb5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:29:25.666031 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04d45dee-06ac-4e3e-99e8-fb7306cc7fb5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:25.666926 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04d45dee-06ac-4e3e-99e8-fb7306cc7fb5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:25.667605 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04d45dee-06ac-4e3e-99e8-fb7306cc7fb5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:25.695604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04d45dee-06ac-4e3e-99e8-fb7306cc7fb5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Going to try to start instance {{(pid=121135) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 17:29:25.877538 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04d45dee-06ac-4e3e-99e8-fb7306cc7fb5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "POST /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/action" status: 202 len: 0 microversion: 2.1 time: 0.223181 Sep 19 17:29:25.878772 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 335/665] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:29:25 2022] POST /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:29:25.888018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f25c6ef-d2e0-4fe7-9ec4-91beea2187be tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:25.888881 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f25c6ef-d2e0-4fe7-9ec4-91beea2187be tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:25.895992 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f25c6ef-d2e0-4fe7-9ec4-91beea2187be tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:25.898587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f25c6ef-d2e0-4fe7-9ec4-91beea2187be tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:25.901405 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f25c6ef-d2e0-4fe7-9ec4-91beea2187be tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:25.902284 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f25c6ef-d2e0-4fe7-9ec4-91beea2187be tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:25.902635 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f25c6ef-d2e0-4fe7-9ec4-91beea2187be tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:25.903069 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f25c6ef-d2e0-4fe7-9ec4-91beea2187be tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:26.151809 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f25c6ef-d2e0-4fe7-9ec4-91beea2187be tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:26.161428 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f25c6ef-d2e0-4fe7-9ec4-91beea2187be tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1710 microversion: 2.1 time: 0.277862 Sep 19 17:29:26.162259 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 331/666] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:25 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1710 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:29:27.191525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-387e4615-a758-4429-9ec6-5dbb8a743517 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:27.193219 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-387e4615-a758-4429-9ec6-5dbb8a743517 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:27.210049 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387e4615-a758-4429-9ec6-5dbb8a743517 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:27.210751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387e4615-a758-4429-9ec6-5dbb8a743517 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:27.212342 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387e4615-a758-4429-9ec6-5dbb8a743517 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:27.213879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387e4615-a758-4429-9ec6-5dbb8a743517 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:27.216403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387e4615-a758-4429-9ec6-5dbb8a743517 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:27.216973 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387e4615-a758-4429-9ec6-5dbb8a743517 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:27.428070 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-387e4615-a758-4429-9ec6-5dbb8a743517 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:27.451766 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-387e4615-a758-4429-9ec6-5dbb8a743517 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1710 microversion: 2.1 time: 0.265626 Sep 19 17:29:27.453743 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 336/667] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:27 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1710 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:28.483032 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5465826-1ea5-4789-8847-1119c38da2b1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:28.483562 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5465826-1ea5-4789-8847-1119c38da2b1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:28.491339 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5465826-1ea5-4789-8847-1119c38da2b1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:28.491971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5465826-1ea5-4789-8847-1119c38da2b1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:28.492624 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5465826-1ea5-4789-8847-1119c38da2b1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:28.493918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5465826-1ea5-4789-8847-1119c38da2b1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:28.494566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5465826-1ea5-4789-8847-1119c38da2b1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:28.495016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5465826-1ea5-4789-8847-1119c38da2b1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:28.649758 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5465826-1ea5-4789-8847-1119c38da2b1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:28.661381 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5465826-1ea5-4789-8847-1119c38da2b1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1710 microversion: 2.1 time: 0.182235 Sep 19 17:29:28.661980 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 332/668] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:28 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1710 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:29:29.684616 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-abe5653a-1e32-434d-8f97-57f611fb9583 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:29.685221 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-abe5653a-1e32-434d-8f97-57f611fb9583 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:29.694532 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abe5653a-1e32-434d-8f97-57f611fb9583 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:29.695022 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abe5653a-1e32-434d-8f97-57f611fb9583 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:29.695462 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abe5653a-1e32-434d-8f97-57f611fb9583 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:29.696230 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abe5653a-1e32-434d-8f97-57f611fb9583 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:29.697090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abe5653a-1e32-434d-8f97-57f611fb9583 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:29.697754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abe5653a-1e32-434d-8f97-57f611fb9583 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:29.848177 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-abe5653a-1e32-434d-8f97-57f611fb9583 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:29.857534 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-abe5653a-1e32-434d-8f97-57f611fb9583 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1714 microversion: 2.1 time: 0.176722 Sep 19 17:29:29.858120 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 337/669] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:29 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1714 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:35.532630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1dd61a3b-41c1-42c6-9627-86c9389f9784 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Action: 'create', calling method: .version_select at 0x7fd4d5f59550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1857113161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8zg/ECAp28vzcYT3E18i6vZYuleeQ5iBdI5eqNmn3GbmTCq2rgID+u8MPrngtFB0qw1N4EI4OLsNpuSItyEDiYSzvpSU9538zrM/l4rli0xSY50a5tahwWUhb7/ntrQg=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:29:35.548361 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-1dd61a3b-41c1-42c6-9627-86c9389f9784 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Getting quotas for project 751acab6697b47e59ee43cf30c937348. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:29:35.552203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-1dd61a3b-41c1-42c6-9627-86c9389f9784 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Getting quotas for user 7d02e6d4bc46456b8faf45e9532caeb1 and project 751acab6697b47e59ee43cf30c937348. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:29:35.628549 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1dd61a3b-41c1-42c6-9627-86c9389f9784 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.099712 Sep 19 17:29:35.629161 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 333/670] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Sep 19 17:29:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:29:35.679607 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2002125777", "imageRef": "3a939fd5-0655-4a08-93c5-d7f2198b35b9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1857113161", "networks": [{"uuid": "5352b9d2-22b9-4ec5-aca8-9a2374a0aa6c"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:29:35.689419 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=36 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:29:35.734108 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] validate_networks() for [('5352b9d2-22b9-4ec5-aca8-9a2374a0aa6c', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:29:36.112462 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:29:36.112890 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:29:36.113365 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:29:36.113785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:29:36.114187 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:29:36.123572 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:36.124085 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:36.124520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:36.125246 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:36.125701 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:36.126127 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:36.143717 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Getting quotas for project 751acab6697b47e59ee43cf30c937348. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:29:36.147644 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Getting quotas for user 7d02e6d4bc46456b8faf45e9532caeb1 and project 751acab6697b47e59ee43cf30c937348. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:29:36.159183 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:29:36.161448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a939fd5-0655-4a08-93c5-d7f2198b35b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:29:36.274376 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9f226cf-4217-44f4-a65b-00807ab7d4ef tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598439 Sep 19 17:29:36.274944 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 338/671] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:29:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:29:36.286689 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-59168493-72d4-4e81-9c5a-3a7edc726db9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:36.287292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-59168493-72d4-4e81-9c5a-3a7edc726db9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:36.350195 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-59168493-72d4-4e81-9c5a-3a7edc726db9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:36.358696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-59168493-72d4-4e81-9c5a-3a7edc726db9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1259 microversion: 2.1 time: 0.075969 Sep 19 17:29:36.359497 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 334/672] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:36 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1259 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:37.381647 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0a8d485c-a68f-4100-98d6-bd97ec6bc6b1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:37.382311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0a8d485c-a68f-4100-98d6-bd97ec6bc6b1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:37.436342 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0a8d485c-a68f-4100-98d6-bd97ec6bc6b1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:37.443122 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0a8d485c-a68f-4100-98d6-bd97ec6bc6b1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1259 microversion: 2.1 time: 0.065853 Sep 19 17:29:37.443687 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 339/673] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:37 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:38.465895 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3d71800-1ef4-43b2-b992-27e57b52052d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:38.466518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3d71800-1ef4-43b2-b992-27e57b52052d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:38.473616 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d71800-1ef4-43b2-b992-27e57b52052d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:38.474107 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d71800-1ef4-43b2-b992-27e57b52052d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:38.474552 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d71800-1ef4-43b2-b992-27e57b52052d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:38.475247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d71800-1ef4-43b2-b992-27e57b52052d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:38.475724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d71800-1ef4-43b2-b992-27e57b52052d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:38.476422 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d71800-1ef4-43b2-b992-27e57b52052d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:38.539250 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f3d71800-1ef4-43b2-b992-27e57b52052d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:38.547510 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3d71800-1ef4-43b2-b992-27e57b52052d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1311 microversion: 2.1 time: 0.084917 Sep 19 17:29:38.548108 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 335/674] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:38 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:39.570504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-212a3433-ef5b-4067-a787-df92d45039db tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:39.570954 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-212a3433-ef5b-4067-a787-df92d45039db tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:39.577781 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-212a3433-ef5b-4067-a787-df92d45039db tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:39.578371 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-212a3433-ef5b-4067-a787-df92d45039db tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:39.578783 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-212a3433-ef5b-4067-a787-df92d45039db tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:39.580463 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-212a3433-ef5b-4067-a787-df92d45039db tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:39.581108 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-212a3433-ef5b-4067-a787-df92d45039db tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:39.581955 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-212a3433-ef5b-4067-a787-df92d45039db tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:39.784993 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-212a3433-ef5b-4067-a787-df92d45039db tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:39.793401 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-212a3433-ef5b-4067-a787-df92d45039db tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.227165 Sep 19 17:29:39.793984 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 340/675] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:39 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:40.819755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9fa42d4b-3e17-48c1-bfd2-30f37be0ea53 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:40.820277 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9fa42d4b-3e17-48c1-bfd2-30f37be0ea53 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:40.826644 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fa42d4b-3e17-48c1-bfd2-30f37be0ea53 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:40.827134 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fa42d4b-3e17-48c1-bfd2-30f37be0ea53 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:40.827578 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fa42d4b-3e17-48c1-bfd2-30f37be0ea53 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:40.828873 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fa42d4b-3e17-48c1-bfd2-30f37be0ea53 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:40.829328 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fa42d4b-3e17-48c1-bfd2-30f37be0ea53 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:40.829759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fa42d4b-3e17-48c1-bfd2-30f37be0ea53 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:40.959457 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9fa42d4b-3e17-48c1-bfd2-30f37be0ea53 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:40.967040 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9fa42d4b-3e17-48c1-bfd2-30f37be0ea53 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.151244 Sep 19 17:29:40.967609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 336/676] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:40 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:41.990384 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b50654b-0e65-41f3-90ff-437739077b8e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:41.997371 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6b50654b-0e65-41f3-90ff-437739077b8e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:41.997496 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b50654b-0e65-41f3-90ff-437739077b8e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:41.997932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b50654b-0e65-41f3-90ff-437739077b8e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:41.998371 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b50654b-0e65-41f3-90ff-437739077b8e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:41.999065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b50654b-0e65-41f3-90ff-437739077b8e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:41.999553 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b50654b-0e65-41f3-90ff-437739077b8e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:42.000124 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b50654b-0e65-41f3-90ff-437739077b8e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:42.164477 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b50654b-0e65-41f3-90ff-437739077b8e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:42.172124 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b50654b-0e65-41f3-90ff-437739077b8e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.185552 Sep 19 17:29:42.172698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 341/677] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:41 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:43.195739 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cb6a965d-5348-4586-ab7e-29d3eaf984a5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:43.196350 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cb6a965d-5348-4586-ab7e-29d3eaf984a5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:43.202589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb6a965d-5348-4586-ab7e-29d3eaf984a5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:43.203066 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb6a965d-5348-4586-ab7e-29d3eaf984a5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:43.203500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb6a965d-5348-4586-ab7e-29d3eaf984a5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:43.204742 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb6a965d-5348-4586-ab7e-29d3eaf984a5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:43.205189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb6a965d-5348-4586-ab7e-29d3eaf984a5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:43.205609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb6a965d-5348-4586-ab7e-29d3eaf984a5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:43.338739 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cb6a965d-5348-4586-ab7e-29d3eaf984a5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:43.346677 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cb6a965d-5348-4586-ab7e-29d3eaf984a5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.154848 Sep 19 17:29:43.347257 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 337/678] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:43 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:44.370740 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-66dda68a-dcc9-4780-ba56-562769ee9361 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:44.371365 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-66dda68a-dcc9-4780-ba56-562769ee9361 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:44.379864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66dda68a-dcc9-4780-ba56-562769ee9361 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:44.380358 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66dda68a-dcc9-4780-ba56-562769ee9361 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:44.380801 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66dda68a-dcc9-4780-ba56-562769ee9361 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:44.381507 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66dda68a-dcc9-4780-ba56-562769ee9361 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:44.381975 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66dda68a-dcc9-4780-ba56-562769ee9361 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:44.382408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66dda68a-dcc9-4780-ba56-562769ee9361 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:44.520949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-66dda68a-dcc9-4780-ba56-562769ee9361 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:44.529319 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-66dda68a-dcc9-4780-ba56-562769ee9361 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.162418 Sep 19 17:29:44.529905 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 342/679] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:44 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:45.441021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ad78771-fac6-4db0-8a96-26332ad8dd7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f43c7503-0ec7-4634-ab0f-a88ffc7da24f"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:29:45.443659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ad78771-fac6-4db0-8a96-26332ad8dd7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:45.445769 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:29:45.450732 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad78771-fac6-4db0-8a96-26332ad8dd7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:45.456454 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad78771-fac6-4db0-8a96-26332ad8dd7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:45.456454 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad78771-fac6-4db0-8a96-26332ad8dd7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:45.456454 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad78771-fac6-4db0-8a96-26332ad8dd7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:45.456454 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad78771-fac6-4db0-8a96-26332ad8dd7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:45.456805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ad78771-fac6-4db0-8a96-26332ad8dd7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:45.553915 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d573ef7f-543c-46e9-a9fe-924342a1cd20 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:45.554790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d573ef7f-543c-46e9-a9fe-924342a1cd20 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:45.562461 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d573ef7f-543c-46e9-a9fe-924342a1cd20 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:45.562958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d573ef7f-543c-46e9-a9fe-924342a1cd20 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:45.563401 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d573ef7f-543c-46e9-a9fe-924342a1cd20 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:45.564940 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d573ef7f-543c-46e9-a9fe-924342a1cd20 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:45.565414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d573ef7f-543c-46e9-a9fe-924342a1cd20 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:45.565850 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d573ef7f-543c-46e9-a9fe-924342a1cd20 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:45.698747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d573ef7f-543c-46e9-a9fe-924342a1cd20 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:45.709054 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d573ef7f-543c-46e9-a9fe-924342a1cd20 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.159029 Sep 19 17:29:45.710011 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 343/680] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:45 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:29:46.355016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:29:46.730529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a951de37-863b-4131-a4be-30a69a14ae01 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:46.731108 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a951de37-863b-4131-a4be-30a69a14ae01 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:46.732926 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:29:46.738895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a951de37-863b-4131-a4be-30a69a14ae01 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:46.739390 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a951de37-863b-4131-a4be-30a69a14ae01 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:46.739881 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a951de37-863b-4131-a4be-30a69a14ae01 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:46.740597 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a951de37-863b-4131-a4be-30a69a14ae01 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:46.741140 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a951de37-863b-4131-a4be-30a69a14ae01 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:46.741589 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a951de37-863b-4131-a4be-30a69a14ae01 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:46.872328 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a951de37-863b-4131-a4be-30a69a14ae01 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:46.880647 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a951de37-863b-4131-a4be-30a69a14ae01 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.153994 Sep 19 17:29:46.892241 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 344/681] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:46 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:29:47.904626 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d0cb12f-26d6-4bfa-b93f-6130ae54abf0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:47.905340 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d0cb12f-26d6-4bfa-b93f-6130ae54abf0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:47.907098 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:29:47.912458 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0cb12f-26d6-4bfa-b93f-6130ae54abf0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:47.912945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0cb12f-26d6-4bfa-b93f-6130ae54abf0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:47.913629 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0cb12f-26d6-4bfa-b93f-6130ae54abf0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:47.914459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0cb12f-26d6-4bfa-b93f-6130ae54abf0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:47.914924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0cb12f-26d6-4bfa-b93f-6130ae54abf0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:47.915359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0cb12f-26d6-4bfa-b93f-6130ae54abf0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:48.063453 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d0cb12f-26d6-4bfa-b93f-6130ae54abf0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:48.071615 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d0cb12f-26d6-4bfa-b93f-6130ae54abf0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.171187 Sep 19 17:29:48.072215 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 345/682] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:47 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:49.094091 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b72dcf9b-2982-4c4f-bc95-ed3747a8356a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:49.094771 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b72dcf9b-2982-4c4f-bc95-ed3747a8356a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:49.101830 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b72dcf9b-2982-4c4f-bc95-ed3747a8356a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:49.102330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b72dcf9b-2982-4c4f-bc95-ed3747a8356a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:49.102774 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b72dcf9b-2982-4c4f-bc95-ed3747a8356a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:49.103491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b72dcf9b-2982-4c4f-bc95-ed3747a8356a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:49.103985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b72dcf9b-2982-4c4f-bc95-ed3747a8356a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:49.104411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b72dcf9b-2982-4c4f-bc95-ed3747a8356a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:49.247041 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b72dcf9b-2982-4c4f-bc95-ed3747a8356a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:49.254645 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b72dcf9b-2982-4c4f-bc95-ed3747a8356a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.164424 Sep 19 17:29:49.255212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 346/683] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:49 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:29:50.280870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a8f3c9a3-4cab-43ca-9e84-5857d21881aa tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:50.283368 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a8f3c9a3-4cab-43ca-9e84-5857d21881aa tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:50.292310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8f3c9a3-4cab-43ca-9e84-5857d21881aa tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:50.293002 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8f3c9a3-4cab-43ca-9e84-5857d21881aa tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:50.293794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8f3c9a3-4cab-43ca-9e84-5857d21881aa tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:50.294927 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8f3c9a3-4cab-43ca-9e84-5857d21881aa tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:50.295543 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8f3c9a3-4cab-43ca-9e84-5857d21881aa tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:50.296063 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8f3c9a3-4cab-43ca-9e84-5857d21881aa tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:50.441188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a8f3c9a3-4cab-43ca-9e84-5857d21881aa tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:50.449456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a8f3c9a3-4cab-43ca-9e84-5857d21881aa tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.174232 Sep 19 17:29:50.463012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 347/684] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:50 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:51.472042 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8498a77e-696b-48fd-8c25-bbe92d911fbb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:51.472703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8498a77e-696b-48fd-8c25-bbe92d911fbb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:51.479185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498a77e-696b-48fd-8c25-bbe92d911fbb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:51.479670 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498a77e-696b-48fd-8c25-bbe92d911fbb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:51.480144 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498a77e-696b-48fd-8c25-bbe92d911fbb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:51.480845 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498a77e-696b-48fd-8c25-bbe92d911fbb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:51.481306 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498a77e-696b-48fd-8c25-bbe92d911fbb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:51.481737 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498a77e-696b-48fd-8c25-bbe92d911fbb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:51.609345 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8498a77e-696b-48fd-8c25-bbe92d911fbb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:51.617441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8498a77e-696b-48fd-8c25-bbe92d911fbb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.149235 Sep 19 17:29:51.617947 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 348/685] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:51 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:29:52.640629 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-789cffc6-31e2-4915-87b9-ab53d468555d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:52.641226 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-789cffc6-31e2-4915-87b9-ab53d468555d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:52.648480 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789cffc6-31e2-4915-87b9-ab53d468555d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:52.648961 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789cffc6-31e2-4915-87b9-ab53d468555d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:52.649399 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789cffc6-31e2-4915-87b9-ab53d468555d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:52.650092 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789cffc6-31e2-4915-87b9-ab53d468555d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:52.650551 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789cffc6-31e2-4915-87b9-ab53d468555d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:52.650981 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789cffc6-31e2-4915-87b9-ab53d468555d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:52.653618 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:29:52.779405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-789cffc6-31e2-4915-87b9-ab53d468555d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:52.786953 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-789cffc6-31e2-4915-87b9-ab53d468555d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.150281 Sep 19 17:29:52.787519 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 349/686] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:52 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:29:53.809567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e3053c5-be6f-4ee4-8816-60b2c868984b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:53.810214 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e3053c5-be6f-4ee4-8816-60b2c868984b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:53.816748 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3053c5-be6f-4ee4-8816-60b2c868984b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:53.817241 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3053c5-be6f-4ee4-8816-60b2c868984b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:53.817747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3053c5-be6f-4ee4-8816-60b2c868984b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:53.818454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3053c5-be6f-4ee4-8816-60b2c868984b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:53.818918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3053c5-be6f-4ee4-8816-60b2c868984b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:53.819353 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e3053c5-be6f-4ee4-8816-60b2c868984b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:53.944055 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2e3053c5-be6f-4ee4-8816-60b2c868984b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:53.951765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e3053c5-be6f-4ee4-8816-60b2c868984b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.146129 Sep 19 17:29:53.952332 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 350/687] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:53 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:29:54.353147 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=60 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:29:54.893213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ad78771-fac6-4db0-8a96-26332ad8dd7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "POST /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.640004 Sep 19 17:29:54.896677 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 338/688] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:29:45 2022] POST /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments => generated 194 bytes in 9641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:29:54.974475 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7fcc1a82-cb16-4a4b-b891-a4d3c135e2c7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:54.975151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7fcc1a82-cb16-4a4b-b891-a4d3c135e2c7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:54.981864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcc1a82-cb16-4a4b-b891-a4d3c135e2c7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:54.982401 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcc1a82-cb16-4a4b-b891-a4d3c135e2c7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:54.982844 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcc1a82-cb16-4a4b-b891-a4d3c135e2c7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:54.983575 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcc1a82-cb16-4a4b-b891-a4d3c135e2c7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:54.984081 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcc1a82-cb16-4a4b-b891-a4d3c135e2c7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:54.984510 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcc1a82-cb16-4a4b-b891-a4d3c135e2c7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:55.074508 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-cae838a8-2870-4631-a6e0-1b353708cffc req-7055d6bc-b225-4220-888d-8b8d6d4265cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "298f2df8-95dc-4ca2-b5d0-f798da2f2b7a", "tag": "973c7f3d-c9c7-4b6e-bd83-8a6e87defccf"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:29:55.085089 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cae838a8-2870-4631-a6e0-1b353708cffc req-7055d6bc-b225-4220-888d-8b8d6d4265cd service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:55.085558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cae838a8-2870-4631-a6e0-1b353708cffc req-7055d6bc-b225-4220-888d-8b8d6d4265cd service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:55.086116 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cae838a8-2870-4631-a6e0-1b353708cffc req-7055d6bc-b225-4220-888d-8b8d6d4265cd service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:55.097768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-cae838a8-2870-4631-a6e0-1b353708cffc req-7055d6bc-b225-4220-888d-8b8d6d4265cd service nova] Creating event network-changed:973c7f3d-c9c7-4b6e-bd83-8a6e87defccf for instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a on hv-cinder-84801 Sep 19 17:29:55.102879 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-cae838a8-2870-4631-a6e0-1b353708cffc req-7055d6bc-b225-4220-888d-8b8d6d4265cd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096976 Sep 19 17:29:55.103531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 339/689] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:29:55.127030 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7fcc1a82-cb16-4a4b-b891-a4d3c135e2c7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:55.134706 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7fcc1a82-cb16-4a4b-b891-a4d3c135e2c7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.164794 Sep 19 17:29:55.135905 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 351/690] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:54 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:56.158979 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1dfd2c1b-f9da-4be8-8fff-b55e732e8cb5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:56.159949 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1dfd2c1b-f9da-4be8-8fff-b55e732e8cb5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:56.166626 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dfd2c1b-f9da-4be8-8fff-b55e732e8cb5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:56.167119 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dfd2c1b-f9da-4be8-8fff-b55e732e8cb5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:56.167557 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dfd2c1b-f9da-4be8-8fff-b55e732e8cb5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:56.168277 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dfd2c1b-f9da-4be8-8fff-b55e732e8cb5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:56.168730 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dfd2c1b-f9da-4be8-8fff-b55e732e8cb5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:56.169177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dfd2c1b-f9da-4be8-8fff-b55e732e8cb5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:56.301757 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1dfd2c1b-f9da-4be8-8fff-b55e732e8cb5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:56.309459 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1dfd2c1b-f9da-4be8-8fff-b55e732e8cb5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.155308 Sep 19 17:29:56.310039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 340/691] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:56 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:57.332367 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d5854c1-d507-43fe-bdd5-77db782e1d6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:57.332899 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7d5854c1-d507-43fe-bdd5-77db782e1d6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:57.339352 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d5854c1-d507-43fe-bdd5-77db782e1d6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:57.339887 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d5854c1-d507-43fe-bdd5-77db782e1d6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:57.340328 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d5854c1-d507-43fe-bdd5-77db782e1d6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:57.341034 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d5854c1-d507-43fe-bdd5-77db782e1d6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:57.341499 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d5854c1-d507-43fe-bdd5-77db782e1d6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:57.341963 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d5854c1-d507-43fe-bdd5-77db782e1d6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:57.468132 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7d5854c1-d507-43fe-bdd5-77db782e1d6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:57.475641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d5854c1-d507-43fe-bdd5-77db782e1d6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.147766 Sep 19 17:29:57.476240 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 352/692] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:57 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:58.498876 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5aa6547-51db-4558-bfa1-c8c77a0093a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:58.499491 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5aa6547-51db-4558-bfa1-c8c77a0093a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:58.505991 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5aa6547-51db-4558-bfa1-c8c77a0093a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:58.506470 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5aa6547-51db-4558-bfa1-c8c77a0093a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:58.506908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5aa6547-51db-4558-bfa1-c8c77a0093a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:58.507607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5aa6547-51db-4558-bfa1-c8c77a0093a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:58.508084 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5aa6547-51db-4558-bfa1-c8c77a0093a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:58.508513 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5aa6547-51db-4558-bfa1-c8c77a0093a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:58.637539 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5aa6547-51db-4558-bfa1-c8c77a0093a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:58.646084 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5aa6547-51db-4558-bfa1-c8c77a0093a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.151154 Sep 19 17:29:58.646657 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 341/693] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:58 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:29:59.668480 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8731f199-4b8a-4e74-a346-15b946d703ee tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:29:59.669099 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8731f199-4b8a-4e74-a346-15b946d703ee tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:29:59.676248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8731f199-4b8a-4e74-a346-15b946d703ee tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:59.676734 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8731f199-4b8a-4e74-a346-15b946d703ee tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:59.677181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8731f199-4b8a-4e74-a346-15b946d703ee tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:59.677877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8731f199-4b8a-4e74-a346-15b946d703ee tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:29:59.678339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8731f199-4b8a-4e74-a346-15b946d703ee tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:29:59.678769 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8731f199-4b8a-4e74-a346-15b946d703ee tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:29:59.806606 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8731f199-4b8a-4e74-a346-15b946d703ee tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:29:59.814159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8731f199-4b8a-4e74-a346-15b946d703ee tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.149510 Sep 19 17:29:59.814731 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 353/694] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:29:59 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:00.836803 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e1962e4-010f-4bbd-9fa2-832272ede8d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:00.837335 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e1962e4-010f-4bbd-9fa2-832272ede8d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:00.843687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e1962e4-010f-4bbd-9fa2-832272ede8d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:00.844194 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e1962e4-010f-4bbd-9fa2-832272ede8d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:00.845127 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e1962e4-010f-4bbd-9fa2-832272ede8d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:00.845808 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e1962e4-010f-4bbd-9fa2-832272ede8d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:00.846254 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e1962e4-010f-4bbd-9fa2-832272ede8d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:00.846676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e1962e4-010f-4bbd-9fa2-832272ede8d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:00.972222 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e1962e4-010f-4bbd-9fa2-832272ede8d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:00.979826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e1962e4-010f-4bbd-9fa2-832272ede8d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.147050 Sep 19 17:30:00.980391 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 342/695] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:00 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:02.004733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4188a35d-e7f9-461a-9870-a916a2228ca3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:02.005466 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4188a35d-e7f9-461a-9870-a916a2228ca3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:02.011748 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4188a35d-e7f9-461a-9870-a916a2228ca3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:02.012560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4188a35d-e7f9-461a-9870-a916a2228ca3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:02.013139 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4188a35d-e7f9-461a-9870-a916a2228ca3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:02.013853 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4188a35d-e7f9-461a-9870-a916a2228ca3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:02.014311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4188a35d-e7f9-461a-9870-a916a2228ca3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:02.014739 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4188a35d-e7f9-461a-9870-a916a2228ca3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:02.149419 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4188a35d-e7f9-461a-9870-a916a2228ca3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:02.158871 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4188a35d-e7f9-461a-9870-a916a2228ca3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.159870 Sep 19 17:30:02.159467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 354/696] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:01 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:03.182431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a465bf54-8954-4e9f-bb0b-7245771b186b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:03.183048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a465bf54-8954-4e9f-bb0b-7245771b186b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:03.190483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a465bf54-8954-4e9f-bb0b-7245771b186b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:03.190951 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a465bf54-8954-4e9f-bb0b-7245771b186b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:03.191389 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a465bf54-8954-4e9f-bb0b-7245771b186b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:03.192136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a465bf54-8954-4e9f-bb0b-7245771b186b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:03.192591 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a465bf54-8954-4e9f-bb0b-7245771b186b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:03.193019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a465bf54-8954-4e9f-bb0b-7245771b186b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:03.319080 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a465bf54-8954-4e9f-bb0b-7245771b186b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:03.326872 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a465bf54-8954-4e9f-bb0b-7245771b186b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.148351 Sep 19 17:30:03.327442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 343/697] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:03 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:03.442044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-d540fffb-fb1e-4b62-b345-16d56a23d380 req-32eb54ec-84a3-4e4d-a789-c030d4bebd32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298f2df8-95dc-4ca2-b5d0-f798da2f2b7a", "name": "network-vif-plugged", "status": "completed", "tag": "973c7f3d-c9c7-4b6e-bd83-8a6e87defccf"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:03.447135 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 17:30:03.447290 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Mon Sep 19 17:30:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Sep 19 17:30:03.454651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d540fffb-fb1e-4b62-b345-16d56a23d380 req-32eb54ec-84a3-4e4d-a789-c030d4bebd32 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:03.455114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d540fffb-fb1e-4b62-b345-16d56a23d380 req-32eb54ec-84a3-4e4d-a789-c030d4bebd32 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:03.455546 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d540fffb-fb1e-4b62-b345-16d56a23d380 req-32eb54ec-84a3-4e4d-a789-c030d4bebd32 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:03.467093 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-d540fffb-fb1e-4b62-b345-16d56a23d380 req-32eb54ec-84a3-4e4d-a789-c030d4bebd32 service nova] Creating event network-vif-plugged:973c7f3d-c9c7-4b6e-bd83-8a6e87defccf for instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a on hv-cinder-84801 Sep 19 17:30:03.472138 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-d540fffb-fb1e-4b62-b345-16d56a23d380 req-32eb54ec-84a3-4e4d-a789-c030d4bebd32 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034291 Sep 19 17:30:03.473015 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 355/698] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:30:04.350103 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-94b22228-a911-4445-aceb-4d968d5a6acd tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:04.350699 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-94b22228-a911-4445-aceb-4d968d5a6acd tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:04.357398 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94b22228-a911-4445-aceb-4d968d5a6acd tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:04.357813 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94b22228-a911-4445-aceb-4d968d5a6acd tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:04.358296 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94b22228-a911-4445-aceb-4d968d5a6acd tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:04.359006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94b22228-a911-4445-aceb-4d968d5a6acd tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:04.359464 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94b22228-a911-4445-aceb-4d968d5a6acd tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:04.359920 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94b22228-a911-4445-aceb-4d968d5a6acd tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:04.496745 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-94b22228-a911-4445-aceb-4d968d5a6acd tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:04.507286 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-94b22228-a911-4445-aceb-4d968d5a6acd tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.161022 Sep 19 17:30:04.507894 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 344/699] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:04 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:05.530676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0ec00db-17df-45a2-8ae9-eca610e719eb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:05.532024 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d0ec00db-17df-45a2-8ae9-eca610e719eb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:05.538352 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ec00db-17df-45a2-8ae9-eca610e719eb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:05.539076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ec00db-17df-45a2-8ae9-eca610e719eb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:05.539513 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ec00db-17df-45a2-8ae9-eca610e719eb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:05.540241 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ec00db-17df-45a2-8ae9-eca610e719eb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:05.540694 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ec00db-17df-45a2-8ae9-eca610e719eb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:05.541122 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ec00db-17df-45a2-8ae9-eca610e719eb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:05.667469 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0ec00db-17df-45a2-8ae9-eca610e719eb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:05.675947 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0ec00db-17df-45a2-8ae9-eca610e719eb tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1359 microversion: 2.1 time: 0.149871 Sep 19 17:30:05.676702 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 356/700] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:05 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:06.698539 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c0d7971-29b2-4ff3-ab37-042eff887618 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:06.699148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6c0d7971-29b2-4ff3-ab37-042eff887618 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:06.706508 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c0d7971-29b2-4ff3-ab37-042eff887618 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:06.707021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c0d7971-29b2-4ff3-ab37-042eff887618 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:06.707452 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c0d7971-29b2-4ff3-ab37-042eff887618 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:06.708170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c0d7971-29b2-4ff3-ab37-042eff887618 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:06.708622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c0d7971-29b2-4ff3-ab37-042eff887618 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:06.709165 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c0d7971-29b2-4ff3-ab37-042eff887618 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:06.841816 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6c0d7971-29b2-4ff3-ab37-042eff887618 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:06.849581 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6c0d7971-29b2-4ff3-ab37-042eff887618 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1549 microversion: 2.1 time: 0.155031 Sep 19 17:30:06.850163 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 345/701] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:06 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:06.875013 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3fbed8fe-065b-4f8e-b433-ff27e39e0c65 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:06.875629 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3fbed8fe-065b-4f8e-b433-ff27e39e0c65 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:06.878259 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:30:06.883008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbed8fe-065b-4f8e-b433-ff27e39e0c65 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:06.883496 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbed8fe-065b-4f8e-b433-ff27e39e0c65 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:06.883967 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbed8fe-065b-4f8e-b433-ff27e39e0c65 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:06.884657 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbed8fe-065b-4f8e-b433-ff27e39e0c65 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:06.885111 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbed8fe-065b-4f8e-b433-ff27e39e0c65 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:06.885535 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbed8fe-065b-4f8e-b433-ff27e39e0c65 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:07.015069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3fbed8fe-065b-4f8e-b433-ff27e39e0c65 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:07.024065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3fbed8fe-065b-4f8e-b433-ff27e39e0c65 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1549 microversion: 2.1 time: 0.152915 Sep 19 17:30:07.024654 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 357/702] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:06 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:07.046066 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a96afcb-c30f-45f2-ac24-f67e37304a6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:07.051346 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a96afcb-c30f-45f2-ac24-f67e37304a6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:07.052173 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0a96afcb-c30f-45f2-ac24-f67e37304a6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Searching by: {'deleted': False, 'project_id': '751acab6697b47e59ee43cf30c937348'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 17:30:07.058877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a96afcb-c30f-45f2-ac24-f67e37304a6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:07.059358 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a96afcb-c30f-45f2-ac24-f67e37304a6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:07.059834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a96afcb-c30f-45f2-ac24-f67e37304a6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:07.060564 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a96afcb-c30f-45f2-ac24-f67e37304a6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:07.061022 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a96afcb-c30f-45f2-ac24-f67e37304a6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:07.061442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a96afcb-c30f-45f2-ac24-f67e37304a6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:07.151658 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-0a96afcb-c30f-45f2-ac24-f67e37304a6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 17:30:07.245815 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a96afcb-c30f-45f2-ac24-f67e37304a6c tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203707 Sep 19 17:30:07.246332 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 346/703] 10.222.0.61 () {58 vars in 1125 bytes} [Mon Sep 19 17:30:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:30:07.258469 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88b1f614-20b2-4c18-b818-558b8466f7b3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:07.259085 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-88b1f614-20b2-4c18-b818-558b8466f7b3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:07.264943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b1f614-20b2-4c18-b818-558b8466f7b3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:07.265449 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b1f614-20b2-4c18-b818-558b8466f7b3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:07.265908 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b1f614-20b2-4c18-b818-558b8466f7b3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:07.266578 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b1f614-20b2-4c18-b818-558b8466f7b3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:07.267285 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b1f614-20b2-4c18-b818-558b8466f7b3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:07.267731 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b1f614-20b2-4c18-b818-558b8466f7b3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:07.392868 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-88b1f614-20b2-4c18-b818-558b8466f7b3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:07.400448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-88b1f614-20b2-4c18-b818-558b8466f7b3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1549 microversion: 2.1 time: 0.145824 Sep 19 17:30:07.401045 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 358/704] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:07 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:07.731681 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d448cf1c-b8ed-4215-b80c-4b979d7c3914 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:07.733860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d448cf1c-b8ed-4215-b80c-4b979d7c3914 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:07.740875 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d448cf1c-b8ed-4215-b80c-4b979d7c3914 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:07.741342 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d448cf1c-b8ed-4215-b80c-4b979d7c3914 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:07.741934 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d448cf1c-b8ed-4215-b80c-4b979d7c3914 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:07.742467 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d448cf1c-b8ed-4215-b80c-4b979d7c3914 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:07.742918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d448cf1c-b8ed-4215-b80c-4b979d7c3914 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:07.743338 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d448cf1c-b8ed-4215-b80c-4b979d7c3914 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:07.774878 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-d448cf1c-b8ed-4215-b80c-4b979d7c3914 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lazy-loading 'flavor' on Instance uuid f2632c0f-04a3-4b90-b4b1-f8989649a34a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:30:08.084595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d448cf1c-b8ed-4215-b80c-4b979d7c3914 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "POST /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/action" status: 200 len: 32 microversion: 2.1 time: 0.355431 Sep 19 17:30:08.089251 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 347/705] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:30:07 2022] POST /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/action => generated 32 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 17:30:08.096849 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-78ab0084-b2e0-45ec-8f07-56a9e59c4518 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:08.097566 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-78ab0084-b2e0-45ec-8f07-56a9e59c4518 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:08.105194 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78ab0084-b2e0-45ec-8f07-56a9e59c4518 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:08.112000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78ab0084-b2e0-45ec-8f07-56a9e59c4518 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:08.112000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78ab0084-b2e0-45ec-8f07-56a9e59c4518 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:08.112000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78ab0084-b2e0-45ec-8f07-56a9e59c4518 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:08.112000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78ab0084-b2e0-45ec-8f07-56a9e59c4518 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:08.112675 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78ab0084-b2e0-45ec-8f07-56a9e59c4518 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:08.247951 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-78ab0084-b2e0-45ec-8f07-56a9e59c4518 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:08.256217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-78ab0084-b2e0-45ec-8f07-56a9e59c4518 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.165235 Sep 19 17:30:08.257073 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 359/706] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:08 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:09.281100 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6d4f797c-2d2d-460a-8389-11102e62474d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:09.281738 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6d4f797c-2d2d-460a-8389-11102e62474d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:09.288973 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d4f797c-2d2d-460a-8389-11102e62474d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:09.289465 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d4f797c-2d2d-460a-8389-11102e62474d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:09.289907 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d4f797c-2d2d-460a-8389-11102e62474d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:09.290606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d4f797c-2d2d-460a-8389-11102e62474d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:09.291064 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d4f797c-2d2d-460a-8389-11102e62474d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:09.291505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d4f797c-2d2d-460a-8389-11102e62474d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:09.418877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6d4f797c-2d2d-460a-8389-11102e62474d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:09.427737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6d4f797c-2d2d-460a-8389-11102e62474d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.150996 Sep 19 17:30:09.428313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 348/707] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:09 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:10.292945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e8ffc55d-1660-4879-b749-d4a4fb6dae96 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adeefcce-4da4-46d4-aac2-0e02e51b9311"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:10.295432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e8ffc55d-1660-4879-b749-d4a4fb6dae96 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:10.301961 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ffc55d-1660-4879-b749-d4a4fb6dae96 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:10.302448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ffc55d-1660-4879-b749-d4a4fb6dae96 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:10.302884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ffc55d-1660-4879-b749-d4a4fb6dae96 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:10.303573 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ffc55d-1660-4879-b749-d4a4fb6dae96 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:10.304052 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ffc55d-1660-4879-b749-d4a4fb6dae96 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:10.304479 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ffc55d-1660-4879-b749-d4a4fb6dae96 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:10.450517 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42a790d2-600c-43da-88eb-a2be1dd8d815 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:10.455891 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42a790d2-600c-43da-88eb-a2be1dd8d815 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:10.458174 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a790d2-600c-43da-88eb-a2be1dd8d815 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:10.458683 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a790d2-600c-43da-88eb-a2be1dd8d815 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:10.459129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a790d2-600c-43da-88eb-a2be1dd8d815 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:10.459856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a790d2-600c-43da-88eb-a2be1dd8d815 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:10.460318 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a790d2-600c-43da-88eb-a2be1dd8d815 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:10.460750 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a790d2-600c-43da-88eb-a2be1dd8d815 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:10.598951 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-42a790d2-600c-43da-88eb-a2be1dd8d815 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:10.607737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42a790d2-600c-43da-88eb-a2be1dd8d815 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.161199 Sep 19 17:30:10.608321 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 349/708] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:10 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:30:10.995602 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e8ffc55d-1660-4879-b749-d4a4fb6dae96 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "POST /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.706370 Sep 19 17:30:10.996307 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 360/709] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:30:10 2022] POST /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:30:11.630547 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-285360ab-e315-469e-a7a8-c19bad25ce23 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:11.635103 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-285360ab-e315-469e-a7a8-c19bad25ce23 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:11.637584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-285360ab-e315-469e-a7a8-c19bad25ce23 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:11.638063 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-285360ab-e315-469e-a7a8-c19bad25ce23 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:11.638496 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-285360ab-e315-469e-a7a8-c19bad25ce23 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:11.639178 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-285360ab-e315-469e-a7a8-c19bad25ce23 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:11.639629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-285360ab-e315-469e-a7a8-c19bad25ce23 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:11.640073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-285360ab-e315-469e-a7a8-c19bad25ce23 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:11.769019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-285360ab-e315-469e-a7a8-c19bad25ce23 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:11.777336 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-285360ab-e315-469e-a7a8-c19bad25ce23 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.150660 Sep 19 17:30:11.777908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 350/710] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:11 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:12.803046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d9a1ba70-776f-457b-8b49-fbf37885f701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:12.803670 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d9a1ba70-776f-457b-8b49-fbf37885f701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:12.810105 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9a1ba70-776f-457b-8b49-fbf37885f701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:12.810631 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9a1ba70-776f-457b-8b49-fbf37885f701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:12.811071 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9a1ba70-776f-457b-8b49-fbf37885f701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:12.811781 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9a1ba70-776f-457b-8b49-fbf37885f701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:12.812272 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9a1ba70-776f-457b-8b49-fbf37885f701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:12.812695 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9a1ba70-776f-457b-8b49-fbf37885f701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:12.946316 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9a1ba70-776f-457b-8b49-fbf37885f701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:12.954639 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d9a1ba70-776f-457b-8b49-fbf37885f701 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.156977 Sep 19 17:30:12.955215 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 361/711] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:12 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:13.978419 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-521cff17-a247-444d-9a3a-01061f17e6c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:13.979772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-521cff17-a247-444d-9a3a-01061f17e6c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:13.986673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-521cff17-a247-444d-9a3a-01061f17e6c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:13.987154 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-521cff17-a247-444d-9a3a-01061f17e6c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:13.987588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-521cff17-a247-444d-9a3a-01061f17e6c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:13.988357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-521cff17-a247-444d-9a3a-01061f17e6c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:13.988758 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-521cff17-a247-444d-9a3a-01061f17e6c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:13.989181 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-521cff17-a247-444d-9a3a-01061f17e6c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:14.123614 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-521cff17-a247-444d-9a3a-01061f17e6c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:14.132743 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-521cff17-a247-444d-9a3a-01061f17e6c2 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.158175 Sep 19 17:30:14.133379 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 351/712] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:13 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:15.158224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e7f954d-eca4-4e12-bbf0-5017d2895f2f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:15.158911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3e7f954d-eca4-4e12-bbf0-5017d2895f2f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:15.166416 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e7f954d-eca4-4e12-bbf0-5017d2895f2f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:15.166972 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e7f954d-eca4-4e12-bbf0-5017d2895f2f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:15.167414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e7f954d-eca4-4e12-bbf0-5017d2895f2f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:15.168156 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e7f954d-eca4-4e12-bbf0-5017d2895f2f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:15.168612 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e7f954d-eca4-4e12-bbf0-5017d2895f2f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:15.169038 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e7f954d-eca4-4e12-bbf0-5017d2895f2f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:15.305642 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3e7f954d-eca4-4e12-bbf0-5017d2895f2f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:15.316363 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e7f954d-eca4-4e12-bbf0-5017d2895f2f tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.161132 Sep 19 17:30:15.316363 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 362/713] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:15 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:16.338608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-918f632f-9079-4b2c-a431-c683ffb710ee tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:16.339230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-918f632f-9079-4b2c-a431-c683ffb710ee tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:16.341663 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=28 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:30:16.346292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-918f632f-9079-4b2c-a431-c683ffb710ee tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:16.346779 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-918f632f-9079-4b2c-a431-c683ffb710ee tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:16.347217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-918f632f-9079-4b2c-a431-c683ffb710ee tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:16.347938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-918f632f-9079-4b2c-a431-c683ffb710ee tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:16.348399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-918f632f-9079-4b2c-a431-c683ffb710ee tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:16.348827 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-918f632f-9079-4b2c-a431-c683ffb710ee tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:16.487191 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-918f632f-9079-4b2c-a431-c683ffb710ee tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:16.489426 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:30:16.496168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-918f632f-9079-4b2c-a431-c683ffb710ee tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.161290 Sep 19 17:30:16.496761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 352/714] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:16 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:17.520717 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-70de1ca4-82ab-4556-a472-533ce0f31e7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:17.521515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-70de1ca4-82ab-4556-a472-533ce0f31e7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:17.528194 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70de1ca4-82ab-4556-a472-533ce0f31e7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:17.528671 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70de1ca4-82ab-4556-a472-533ce0f31e7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:17.529106 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70de1ca4-82ab-4556-a472-533ce0f31e7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:17.529794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70de1ca4-82ab-4556-a472-533ce0f31e7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:17.530244 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70de1ca4-82ab-4556-a472-533ce0f31e7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:17.530667 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70de1ca4-82ab-4556-a472-533ce0f31e7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:17.666298 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-70de1ca4-82ab-4556-a472-533ce0f31e7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:17.675790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-70de1ca4-82ab-4556-a472-533ce0f31e7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.159034 Sep 19 17:30:17.676370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 363/715] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:17 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:18.700655 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ccf0ab1f-1b2d-4092-b890-71fc02e4bc9c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:18.701279 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ccf0ab1f-1b2d-4092-b890-71fc02e4bc9c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:18.704676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:30:18.709474 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccf0ab1f-1b2d-4092-b890-71fc02e4bc9c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:18.709983 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccf0ab1f-1b2d-4092-b890-71fc02e4bc9c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:18.710423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccf0ab1f-1b2d-4092-b890-71fc02e4bc9c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:18.711138 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccf0ab1f-1b2d-4092-b890-71fc02e4bc9c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:18.711591 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccf0ab1f-1b2d-4092-b890-71fc02e4bc9c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:18.712040 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccf0ab1f-1b2d-4092-b890-71fc02e4bc9c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:18.852976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ccf0ab1f-1b2d-4092-b890-71fc02e4bc9c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:18.861949 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ccf0ab1f-1b2d-4092-b890-71fc02e4bc9c tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.165472 Sep 19 17:30:18.862550 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 353/716] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:18 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:19.686784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-543ee6bc-082b-4961-80d5-e7d4eba2b1a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:19.687399 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-543ee6bc-082b-4961-80d5-e7d4eba2b1a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:19.694801 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543ee6bc-082b-4961-80d5-e7d4eba2b1a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:19.695294 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543ee6bc-082b-4961-80d5-e7d4eba2b1a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:19.695753 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543ee6bc-082b-4961-80d5-e7d4eba2b1a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:19.696448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543ee6bc-082b-4961-80d5-e7d4eba2b1a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:19.696897 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543ee6bc-082b-4961-80d5-e7d4eba2b1a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:19.697324 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543ee6bc-082b-4961-80d5-e7d4eba2b1a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:19.836203 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-543ee6bc-082b-4961-80d5-e7d4eba2b1a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:19.841268 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-543ee6bc-082b-4961-80d5-e7d4eba2b1a1 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1595 microversion: 2.1 time: 0.158344 Sep 19 17:30:19.841908 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 364/717] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:19 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:19.888331 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-32ce3281-9d0f-4d41-8939-6d50bfd50418 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:19.888983 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-32ce3281-9d0f-4d41-8939-6d50bfd50418 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:19.897951 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ce3281-9d0f-4d41-8939-6d50bfd50418 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:19.898486 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ce3281-9d0f-4d41-8939-6d50bfd50418 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:19.899525 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ce3281-9d0f-4d41-8939-6d50bfd50418 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:19.900232 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ce3281-9d0f-4d41-8939-6d50bfd50418 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:19.900698 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ce3281-9d0f-4d41-8939-6d50bfd50418 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:19.910808 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ce3281-9d0f-4d41-8939-6d50bfd50418 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:20.081951 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-32ce3281-9d0f-4d41-8939-6d50bfd50418 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:20.090521 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-32ce3281-9d0f-4d41-8939-6d50bfd50418 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.208598 Sep 19 17:30:20.091100 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 354/718] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:19 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:21.115109 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-189c341b-f126-4e0f-a12d-986a5c2c4e87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:21.115839 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-189c341b-f126-4e0f-a12d-986a5c2c4e87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:21.122689 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-189c341b-f126-4e0f-a12d-986a5c2c4e87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:21.123180 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-189c341b-f126-4e0f-a12d-986a5c2c4e87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:21.123616 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-189c341b-f126-4e0f-a12d-986a5c2c4e87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:21.124394 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-189c341b-f126-4e0f-a12d-986a5c2c4e87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:21.124843 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-189c341b-f126-4e0f-a12d-986a5c2c4e87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:21.125262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-189c341b-f126-4e0f-a12d-986a5c2c4e87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:21.130292 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:30:21.266833 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-189c341b-f126-4e0f-a12d-986a5c2c4e87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:21.275281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-189c341b-f126-4e0f-a12d-986a5c2c4e87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.164010 Sep 19 17:30:21.275894 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 365/719] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:21 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:22.231684 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-699be2c8-7de7-486f-a8bc-ffc6d9fa8a0d req-e2390a56-73c8-4334-b637-249d6773764f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "298f2df8-95dc-4ca2-b5d0-f798da2f2b7a", "tag": "973c7f3d-c9c7-4b6e-bd83-8a6e87defccf"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:22.252762 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-699be2c8-7de7-486f-a8bc-ffc6d9fa8a0d req-e2390a56-73c8-4334-b637-249d6773764f service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:22.253483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-699be2c8-7de7-486f-a8bc-ffc6d9fa8a0d req-e2390a56-73c8-4334-b637-249d6773764f service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:22.253993 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-699be2c8-7de7-486f-a8bc-ffc6d9fa8a0d req-e2390a56-73c8-4334-b637-249d6773764f service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:22.267051 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-699be2c8-7de7-486f-a8bc-ffc6d9fa8a0d req-e2390a56-73c8-4334-b637-249d6773764f service nova] Creating event network-changed:973c7f3d-c9c7-4b6e-bd83-8a6e87defccf for instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a on hv-cinder-84801 Sep 19 17:30:22.272499 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-699be2c8-7de7-486f-a8bc-ffc6d9fa8a0d req-e2390a56-73c8-4334-b637-249d6773764f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046134 Sep 19 17:30:22.275817 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 355/720] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:30:22.299958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-864ece16-ba50-4528-b59e-55dcfdbf0a79 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:22.300564 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-864ece16-ba50-4528-b59e-55dcfdbf0a79 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:22.306875 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-864ece16-ba50-4528-b59e-55dcfdbf0a79 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:22.307356 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-864ece16-ba50-4528-b59e-55dcfdbf0a79 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:22.307835 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-864ece16-ba50-4528-b59e-55dcfdbf0a79 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:22.308527 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-864ece16-ba50-4528-b59e-55dcfdbf0a79 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:22.308985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-864ece16-ba50-4528-b59e-55dcfdbf0a79 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:22.309405 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-864ece16-ba50-4528-b59e-55dcfdbf0a79 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:22.481856 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-864ece16-ba50-4528-b59e-55dcfdbf0a79 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:22.492012 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-864ece16-ba50-4528-b59e-55dcfdbf0a79 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.195288 Sep 19 17:30:22.495901 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 366/721] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:22 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:23.519669 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-106fc45e-0996-4587-a072-297426492da3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:23.520462 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-106fc45e-0996-4587-a072-297426492da3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:23.527364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-106fc45e-0996-4587-a072-297426492da3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:23.527943 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-106fc45e-0996-4587-a072-297426492da3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:23.528452 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-106fc45e-0996-4587-a072-297426492da3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:23.529163 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-106fc45e-0996-4587-a072-297426492da3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:23.529618 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-106fc45e-0996-4587-a072-297426492da3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:23.530046 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-106fc45e-0996-4587-a072-297426492da3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:23.695984 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-106fc45e-0996-4587-a072-297426492da3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:23.705508 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-106fc45e-0996-4587-a072-297426492da3 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.191584 Sep 19 17:30:23.706110 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 356/722] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:23 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:24.730479 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-55737135-05f1-44b5-b19a-7302ab87483e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:24.731018 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-55737135-05f1-44b5-b19a-7302ab87483e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:24.738009 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55737135-05f1-44b5-b19a-7302ab87483e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:24.738577 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55737135-05f1-44b5-b19a-7302ab87483e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:24.739064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55737135-05f1-44b5-b19a-7302ab87483e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:24.746226 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55737135-05f1-44b5-b19a-7302ab87483e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:24.746226 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55737135-05f1-44b5-b19a-7302ab87483e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:24.746226 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55737135-05f1-44b5-b19a-7302ab87483e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:24.895364 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-55737135-05f1-44b5-b19a-7302ab87483e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:24.903809 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-55737135-05f1-44b5-b19a-7302ab87483e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.177385 Sep 19 17:30:24.904384 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 367/723] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:24 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:25.448074 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-127d853f-e20d-49ae-91a1-b486c7e2c22a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-251688986"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:25.448631 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-127d853f-e20d-49ae-91a1-b486c7e2c22a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:25.455606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-127d853f-e20d-49ae-91a1-b486c7e2c22a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:25.456122 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-127d853f-e20d-49ae-91a1-b486c7e2c22a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:25.456586 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-127d853f-e20d-49ae-91a1-b486c7e2c22a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:25.457311 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-127d853f-e20d-49ae-91a1-b486c7e2c22a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:25.457809 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-127d853f-e20d-49ae-91a1-b486c7e2c22a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:25.458234 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-127d853f-e20d-49ae-91a1-b486c7e2c22a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:25.582872 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.network.security_group_api [None req-127d853f-e20d-49ae-91a1-b486c7e2c22a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Adding security group b13baf59-e04a-4ef8-8152-e60be2d24070 to port 973c7f3d-c9c7-4b6e-bd83-8a6e87defccf Sep 19 17:30:25.927525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61965aa1-8791-477d-af6c-3edeb8ed672d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:25.939611 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-61965aa1-8791-477d-af6c-3edeb8ed672d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:25.939611 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61965aa1-8791-477d-af6c-3edeb8ed672d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:25.939611 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61965aa1-8791-477d-af6c-3edeb8ed672d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:25.939611 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61965aa1-8791-477d-af6c-3edeb8ed672d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:25.940036 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61965aa1-8791-477d-af6c-3edeb8ed672d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:25.940036 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61965aa1-8791-477d-af6c-3edeb8ed672d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:25.940036 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61965aa1-8791-477d-af6c-3edeb8ed672d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:26.225981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-127d853f-e20d-49ae-91a1-b486c7e2c22a tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "POST /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/action" status: 202 len: 0 microversion: 2.1 time: 0.782114 Sep 19 17:30:26.226676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 357/724] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:30:25 2022] POST /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/action => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:30:26.234466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec20265f-c02d-4581-b045-b1a7f45bdb51 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:26.235075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec20265f-c02d-4581-b045-b1a7f45bdb51 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:26.242686 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec20265f-c02d-4581-b045-b1a7f45bdb51 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:26.243175 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec20265f-c02d-4581-b045-b1a7f45bdb51 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:26.243620 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec20265f-c02d-4581-b045-b1a7f45bdb51 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:26.244351 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec20265f-c02d-4581-b045-b1a7f45bdb51 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:26.244877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec20265f-c02d-4581-b045-b1a7f45bdb51 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:26.245283 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec20265f-c02d-4581-b045-b1a7f45bdb51 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:26.411470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-61965aa1-8791-477d-af6c-3edeb8ed672d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:26.420410 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-61965aa1-8791-477d-af6c-3edeb8ed672d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.497164 Sep 19 17:30:26.421299 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 368/725] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:25 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:30:26.476123 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ec20265f-c02d-4581-b045-b1a7f45bdb51 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:26.485196 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec20265f-c02d-4581-b045-b1a7f45bdb51 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1760 microversion: 2.1 time: 0.254305 Sep 19 17:30:26.487246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 358/726] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:26 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1760 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:30:26.507197 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b96a3317-4850-4282-81f7-898a1e5510c8 req-de36cb40-2ab2-4c8b-bf7d-71c1a7fb152a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "298f2df8-95dc-4ca2-b5d0-f798da2f2b7a", "tag": "973c7f3d-c9c7-4b6e-bd83-8a6e87defccf"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:26.519588 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b96a3317-4850-4282-81f7-898a1e5510c8 req-de36cb40-2ab2-4c8b-bf7d-71c1a7fb152a service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:26.520227 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b96a3317-4850-4282-81f7-898a1e5510c8 req-de36cb40-2ab2-4c8b-bf7d-71c1a7fb152a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:26.520771 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b96a3317-4850-4282-81f7-898a1e5510c8 req-de36cb40-2ab2-4c8b-bf7d-71c1a7fb152a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:26.534777 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b96a3317-4850-4282-81f7-898a1e5510c8 req-de36cb40-2ab2-4c8b-bf7d-71c1a7fb152a service nova] Creating event network-changed:973c7f3d-c9c7-4b6e-bd83-8a6e87defccf for instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a on hv-cinder-84801 Sep 19 17:30:26.543305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b96a3317-4850-4282-81f7-898a1e5510c8 req-de36cb40-2ab2-4c8b-bf7d-71c1a7fb152a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119416 Sep 19 17:30:26.543992 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 369/727] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:30:27.448767 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03d1ec2b-3477-4833-a227-1a95be62af87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:27.449380 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03d1ec2b-3477-4833-a227-1a95be62af87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:27.455423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d1ec2b-3477-4833-a227-1a95be62af87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:27.455940 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d1ec2b-3477-4833-a227-1a95be62af87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:27.456381 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d1ec2b-3477-4833-a227-1a95be62af87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:27.457166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d1ec2b-3477-4833-a227-1a95be62af87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:27.457525 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d1ec2b-3477-4833-a227-1a95be62af87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:27.457949 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d1ec2b-3477-4833-a227-1a95be62af87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:27.593537 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-03d1ec2b-3477-4833-a227-1a95be62af87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:27.602166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03d1ec2b-3477-4833-a227-1a95be62af87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1737 microversion: 2.1 time: 0.157269 Sep 19 17:30:27.602742 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 359/728] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:27 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:28.627407 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a929c13-8522-4946-825d-7f5c9085ec84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:28.628137 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a929c13-8522-4946-825d-7f5c9085ec84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:28.634303 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a929c13-8522-4946-825d-7f5c9085ec84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:28.634798 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a929c13-8522-4946-825d-7f5c9085ec84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:28.635243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a929c13-8522-4946-825d-7f5c9085ec84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:28.636037 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a929c13-8522-4946-825d-7f5c9085ec84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:28.636514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a929c13-8522-4946-825d-7f5c9085ec84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:28.636949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a929c13-8522-4946-825d-7f5c9085ec84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:28.766843 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a929c13-8522-4946-825d-7f5c9085ec84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:28.775773 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a929c13-8522-4946-825d-7f5c9085ec84 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1717 microversion: 2.1 time: 0.153549 Sep 19 17:30:28.776374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 370/729] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:28 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:28.839456 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:28.839971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:28.846992 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:28.847472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:28.847928 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:28.848614 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:28.849104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:28.849533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:28.978640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] HTTP exception thrown: Cannot 'detach_volume' instance f2632c0f-04a3-4b90-b4b1-f8989649a34a while it is in vm_state rescued Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Request method failure captured: Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments/f43c7503-0ec7-4634-ab0f-a88ffc7da24f HTTP/1.1 Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWMWEfop28VzjVJxhEt1SrAA6vyu-Djio5TQQ93Op_5LUruPf_K-j6q9Ueg4oIQCsMrIXevBlXeqOdKnn9vWSqE1F-p6cnVQWlCOcxrCZxCtS7BtyW145HEy0dAywADtm3t4USmgSJLNoWRwvsKSouHGmnzxc_QEXYcwdBWu0ZBG_s Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 4118102ca29c4b0fa344b21b9c9f1e85 Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:30:28.980280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:30:28.981645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4118102ca29c4b0fa344b21b9c9f1e85"}]}] Sep 19 17:30:28.981645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:30:28.981645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 4118102ca29c4b0fa344b21b9c9f1e85 Sep 19 17:30:28.981645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:30:28.981645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-ServerRescueNegativeTestJSON-847106187-project Sep 19 17:30:28.981645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:30:28.981645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:30:28.981645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 4f460a4884d1486484a683f440459b6e Sep 19 17:30:28.981645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-847106187-project Sep 19 17:30:28.981645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:30:28.981645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Cannot 'detach_volume' instance f2632c0f-04a3-4b90-b4b1-f8989649a34a while it is in vm_state rescued Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'server_id': 'f2632c0f-04a3-4b90-b4b1-f8989649a34a', 'id': 'f43c7503-0ec7-4634-ab0f-a88ffc7da24f'} Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2632c0f-04a3-4b90-b4b1-f8989649a34a in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:30:28.982325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f2632c0f-04a3-4b90-b4b1-f8989649a34a while it is in vm_state rescued Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f2632c0f-04a3-4b90-b4b1-f8989649a34a while it is in vm_state rescued Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:30:28.983538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Returning 409 to user: Cannot 'detach_volume' instance f2632c0f-04a3-4b90-b4b1-f8989649a34a while it is in vm_state rescued {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:30:28.984794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-83eab87a-60a6-48ba-ac7f-be6c76cdcbd1 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments/f43c7503-0ec7-4634-ab0f-a88ffc7da24f" status: 409 len: 152 microversion: 2.1 time: 0.146269 Sep 19 17:30:28.984794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 360/730] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:30:28 2022] DELETE /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments/f43c7503-0ec7-4634-ab0f-a88ffc7da24f => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 17:30:28.991631 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cdf3ddd6-d389-4914-8829-62fc1c259c4a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:28.997643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cdf3ddd6-d389-4914-8829-62fc1c259c4a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:28.999642 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdf3ddd6-d389-4914-8829-62fc1c259c4a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:29.000178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdf3ddd6-d389-4914-8829-62fc1c259c4a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:29.000612 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdf3ddd6-d389-4914-8829-62fc1c259c4a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:29.001975 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdf3ddd6-d389-4914-8829-62fc1c259c4a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:29.002486 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdf3ddd6-d389-4914-8829-62fc1c259c4a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:29.002919 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdf3ddd6-d389-4914-8829-62fc1c259c4a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:29.252870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cdf3ddd6-d389-4914-8829-62fc1c259c4a tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "POST /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/action" status: 202 len: 0 microversion: 2.1 time: 0.264947 Sep 19 17:30:29.253744 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 371/731] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:30:28 2022] POST /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:30:29.261859 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1024b4de-2140-4836-9d2a-3759f76e15be tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:29.262736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1024b4de-2140-4836-9d2a-3759f76e15be tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:29.270075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1024b4de-2140-4836-9d2a-3759f76e15be tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:29.270574 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1024b4de-2140-4836-9d2a-3759f76e15be tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:29.271018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1024b4de-2140-4836-9d2a-3759f76e15be tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:29.271974 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1024b4de-2140-4836-9d2a-3759f76e15be tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:29.272519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1024b4de-2140-4836-9d2a-3759f76e15be tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:29.273174 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1024b4de-2140-4836-9d2a-3759f76e15be tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:29.404081 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1024b4de-2140-4836-9d2a-3759f76e15be tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:29.412904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1024b4de-2140-4836-9d2a-3759f76e15be tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1725 microversion: 2.1 time: 0.154922 Sep 19 17:30:29.413485 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 361/732] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:29 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:30:30.437780 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1010ce26-71a9-4b76-ac34-28783ee58421 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:30.438577 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1010ce26-71a9-4b76-ac34-28783ee58421 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:30.446945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1010ce26-71a9-4b76-ac34-28783ee58421 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:30.447604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1010ce26-71a9-4b76-ac34-28783ee58421 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:30.449433 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1010ce26-71a9-4b76-ac34-28783ee58421 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:30.450168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1010ce26-71a9-4b76-ac34-28783ee58421 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:30.450632 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1010ce26-71a9-4b76-ac34-28783ee58421 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:30.451161 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1010ce26-71a9-4b76-ac34-28783ee58421 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:30.604047 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1010ce26-71a9-4b76-ac34-28783ee58421 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:30.618652 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1010ce26-71a9-4b76-ac34-28783ee58421 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1725 microversion: 2.1 time: 0.185308 Sep 19 17:30:30.619094 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 372/733] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:30 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:31.643405 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93854099-ed9d-460b-bcdf-1f72522dfdc9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:31.644118 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-93854099-ed9d-460b-bcdf-1f72522dfdc9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:31.650803 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93854099-ed9d-460b-bcdf-1f72522dfdc9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:31.651359 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93854099-ed9d-460b-bcdf-1f72522dfdc9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:31.651898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93854099-ed9d-460b-bcdf-1f72522dfdc9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:31.652602 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93854099-ed9d-460b-bcdf-1f72522dfdc9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:31.653069 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93854099-ed9d-460b-bcdf-1f72522dfdc9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:31.653498 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93854099-ed9d-460b-bcdf-1f72522dfdc9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:31.788347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-93854099-ed9d-460b-bcdf-1f72522dfdc9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:31.796700 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93854099-ed9d-460b-bcdf-1f72522dfdc9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1725 microversion: 2.1 time: 0.157974 Sep 19 17:30:31.797271 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 362/734] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:31 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:32.820708 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ca1ba36-edbe-4cce-adcb-807c7567c198 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:32.821287 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8ca1ba36-edbe-4cce-adcb-807c7567c198 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:32.829340 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba36-edbe-4cce-adcb-807c7567c198 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:32.829847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba36-edbe-4cce-adcb-807c7567c198 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:32.830295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba36-edbe-4cce-adcb-807c7567c198 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:32.831010 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba36-edbe-4cce-adcb-807c7567c198 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:32.831475 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba36-edbe-4cce-adcb-807c7567c198 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:32.831955 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba36-edbe-4cce-adcb-807c7567c198 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:32.970784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8ca1ba36-edbe-4cce-adcb-807c7567c198 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:32.981722 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ca1ba36-edbe-4cce-adcb-807c7567c198 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1725 microversion: 2.1 time: 0.164908 Sep 19 17:30:32.982315 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 373/735] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:32 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:34.010289 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bf9a1d1-b86c-4395-878f-ff4dd75d8a3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:34.011169 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1bf9a1d1-b86c-4395-878f-ff4dd75d8a3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:34.020627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf9a1d1-b86c-4395-878f-ff4dd75d8a3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:34.021141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf9a1d1-b86c-4395-878f-ff4dd75d8a3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:34.021593 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf9a1d1-b86c-4395-878f-ff4dd75d8a3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:34.022318 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf9a1d1-b86c-4395-878f-ff4dd75d8a3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:34.023429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf9a1d1-b86c-4395-878f-ff4dd75d8a3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:34.023429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf9a1d1-b86c-4395-878f-ff4dd75d8a3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:34.184681 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1bf9a1d1-b86c-4395-878f-ff4dd75d8a3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:34.197262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bf9a1d1-b86c-4395-878f-ff4dd75d8a3d tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1731 microversion: 2.1 time: 0.194912 Sep 19 17:30:34.197867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 363/736] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:34 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:34.222592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3209f9a9-f7da-4e09-991e-889745707291 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:34.223135 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3209f9a9-f7da-4e09-991e-889745707291 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:34.229636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3209f9a9-f7da-4e09-991e-889745707291 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:34.230740 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3209f9a9-f7da-4e09-991e-889745707291 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:34.230740 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3209f9a9-f7da-4e09-991e-889745707291 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:34.231274 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3209f9a9-f7da-4e09-991e-889745707291 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:34.231752 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3209f9a9-f7da-4e09-991e-889745707291 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:34.232182 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3209f9a9-f7da-4e09-991e-889745707291 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:34.316561 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3209f9a9-f7da-4e09-991e-889745707291 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099074 Sep 19 17:30:34.317164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 374/737] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Sep 19 17:30:34 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:30:35.289584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2b465b36-24b4-4749-ba4a-125a1e09dd1e req-e22f6f5b-952b-47ec-8bb2-6efc34799d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2632c0f-04a3-4b90-b4b1-f8989649a34a", "tag": "8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:35.300284 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2b465b36-24b4-4749-ba4a-125a1e09dd1e req-e22f6f5b-952b-47ec-8bb2-6efc34799d5d service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:35.300760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2b465b36-24b4-4749-ba4a-125a1e09dd1e req-e22f6f5b-952b-47ec-8bb2-6efc34799d5d service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:35.305635 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2b465b36-24b4-4749-ba4a-125a1e09dd1e req-e22f6f5b-952b-47ec-8bb2-6efc34799d5d service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:35.314922 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2b465b36-24b4-4749-ba4a-125a1e09dd1e req-e22f6f5b-952b-47ec-8bb2-6efc34799d5d service nova] Creating event network-changed:8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0 for instance f2632c0f-04a3-4b90-b4b1-f8989649a34a on hv-cinder-84801 Sep 19 17:30:35.323288 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2b465b36-24b4-4749-ba4a-125a1e09dd1e req-e22f6f5b-952b-47ec-8bb2-6efc34799d5d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037439 Sep 19 17:30:35.323981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 364/738] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:30:37.338281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-12b5392b-fb52-4ac7-aedd-fa16f655f60b req-7c0b450a-571b-4848-8bc8-8200fd1af7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2632c0f-04a3-4b90-b4b1-f8989649a34a", "tag": "8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:37.343258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=36 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:30:37.348988 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-12b5392b-fb52-4ac7-aedd-fa16f655f60b req-7c0b450a-571b-4848-8bc8-8200fd1af7b8 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:37.349471 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-12b5392b-fb52-4ac7-aedd-fa16f655f60b req-7c0b450a-571b-4848-8bc8-8200fd1af7b8 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:37.349907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-12b5392b-fb52-4ac7-aedd-fa16f655f60b req-7c0b450a-571b-4848-8bc8-8200fd1af7b8 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:37.362045 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-12b5392b-fb52-4ac7-aedd-fa16f655f60b req-7c0b450a-571b-4848-8bc8-8200fd1af7b8 service nova] Creating event network-changed:8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0 for instance f2632c0f-04a3-4b90-b4b1-f8989649a34a on hv-cinder-84801 Sep 19 17:30:37.367418 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-12b5392b-fb52-4ac7-aedd-fa16f655f60b req-7c0b450a-571b-4848-8bc8-8200fd1af7b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033296 Sep 19 17:30:37.368051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 375/739] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:30:38.416302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b9afe03-02e4-4686-89ac-f215f3237fb0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:38.416837 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0b9afe03-02e4-4686-89ac-f215f3237fb0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:38.423865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9afe03-02e4-4686-89ac-f215f3237fb0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:38.424348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9afe03-02e4-4686-89ac-f215f3237fb0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:38.424791 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9afe03-02e4-4686-89ac-f215f3237fb0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:38.425509 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9afe03-02e4-4686-89ac-f215f3237fb0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:38.425963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9afe03-02e4-4686-89ac-f215f3237fb0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:38.426392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9afe03-02e4-4686-89ac-f215f3237fb0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:38.459578 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0b9afe03-02e4-4686-89ac-f215f3237fb0 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments/8921c8f2-b47c-403f-9a01-547ac6d26825" status: 200 len: 194 microversion: 2.20 time: 0.048371 Sep 19 17:30:38.460283 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 365/740] 10.222.0.61 () {60 vars in 1454 bytes} [Mon Sep 19 17:30:38 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments/8921c8f2-b47c-403f-9a01-547ac6d26825 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:30:38.531912 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f551811b-902b-4135-b5e0-d1047987f5b7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:38.533031 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f551811b-902b-4135-b5e0-d1047987f5b7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:38.539974 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f551811b-902b-4135-b5e0-d1047987f5b7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:38.540466 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f551811b-902b-4135-b5e0-d1047987f5b7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:38.540910 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f551811b-902b-4135-b5e0-d1047987f5b7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:38.542440 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f551811b-902b-4135-b5e0-d1047987f5b7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:38.542908 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f551811b-902b-4135-b5e0-d1047987f5b7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:38.543344 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f551811b-902b-4135-b5e0-d1047987f5b7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:38.625477 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-f551811b-902b-4135-b5e0-d1047987f5b7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lazy-loading 'services' on Instance uuid 8d2eb485-3b5a-4326-bd4f-9029da4e6744 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:30:38.831199 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f551811b-902b-4135-b5e0-d1047987f5b7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments/8921c8f2-b47c-403f-9a01-547ac6d26825" status: 202 len: 0 microversion: 2.20 time: 0.303394 Sep 19 17:30:38.835481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 376/741] 10.222.0.61 () {60 vars in 1457 bytes} [Mon Sep 19 17:30:38 2022] DELETE /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments/8921c8f2-b47c-403f-9a01-547ac6d26825 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:30:38.842919 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc0f2c2c-2998-4bf1-b681-968e6703c0ef tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:38.847220 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fc0f2c2c-2998-4bf1-b681-968e6703c0ef tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:38.856016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f2c2c-2998-4bf1-b681-968e6703c0ef tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:38.856539 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f2c2c-2998-4bf1-b681-968e6703c0ef tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:38.857052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f2c2c-2998-4bf1-b681-968e6703c0ef tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:38.857821 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f2c2c-2998-4bf1-b681-968e6703c0ef tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:38.858437 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f2c2c-2998-4bf1-b681-968e6703c0ef tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:38.858896 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f2c2c-2998-4bf1-b681-968e6703c0ef tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:38.887802 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc0f2c2c-2998-4bf1-b681-968e6703c0ef tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051173 Sep 19 17:30:38.888410 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 366/742] 10.222.0.61 () {60 vars in 1343 bytes} [Mon Sep 19 17:30:38 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:30:39.901926 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27f936d7-1fb8-4d2f-8220-e57971fa39d9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:39.904278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-27f936d7-1fb8-4d2f-8220-e57971fa39d9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:39.911318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27f936d7-1fb8-4d2f-8220-e57971fa39d9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:39.911837 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27f936d7-1fb8-4d2f-8220-e57971fa39d9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:39.912273 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27f936d7-1fb8-4d2f-8220-e57971fa39d9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:39.912954 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27f936d7-1fb8-4d2f-8220-e57971fa39d9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:39.913402 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27f936d7-1fb8-4d2f-8220-e57971fa39d9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:39.913824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27f936d7-1fb8-4d2f-8220-e57971fa39d9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:39.945748 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27f936d7-1fb8-4d2f-8220-e57971fa39d9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048154 Sep 19 17:30:39.946295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 377/743] 10.222.0.61 () {60 vars in 1343 bytes} [Mon Sep 19 17:30:39 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:30:40.959458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f3c4268-a5fb-45ee-a8df-4986a80cccad tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:40.961643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8f3c4268-a5fb-45ee-a8df-4986a80cccad tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:40.968145 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f3c4268-a5fb-45ee-a8df-4986a80cccad tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:40.968562 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f3c4268-a5fb-45ee-a8df-4986a80cccad tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:40.969006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f3c4268-a5fb-45ee-a8df-4986a80cccad tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:40.969705 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f3c4268-a5fb-45ee-a8df-4986a80cccad tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:40.970172 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f3c4268-a5fb-45ee-a8df-4986a80cccad tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:40.970590 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f3c4268-a5fb-45ee-a8df-4986a80cccad tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:40.999265 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f3c4268-a5fb-45ee-a8df-4986a80cccad tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043864 Sep 19 17:30:41.007481 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 367/744] 10.222.0.61 () {60 vars in 1343 bytes} [Mon Sep 19 17:30:40 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:41.064017 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-644cdb7d-8bf6-485b-844e-c954e8dbdd5a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:41.064524 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-644cdb7d-8bf6-485b-844e-c954e8dbdd5a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:41.070809 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644cdb7d-8bf6-485b-844e-c954e8dbdd5a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:41.071284 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644cdb7d-8bf6-485b-844e-c954e8dbdd5a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:41.071736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644cdb7d-8bf6-485b-844e-c954e8dbdd5a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:41.072420 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644cdb7d-8bf6-485b-844e-c954e8dbdd5a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:41.072902 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644cdb7d-8bf6-485b-844e-c954e8dbdd5a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:41.073324 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644cdb7d-8bf6-485b-844e-c954e8dbdd5a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:41.097969 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-644cdb7d-8bf6-485b-844e-c954e8dbdd5a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:30:41.305802 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-644cdb7d-8bf6-485b-844e-c954e8dbdd5a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 204 len: 0 microversion: 2.20 time: 0.245825 Sep 19 17:30:41.306351 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 378/745] 10.222.0.61 () {60 vars in 1280 bytes} [Mon Sep 19 17:30:41 2022] DELETE /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 17:30:41.314849 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:41.315472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:41.321442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:41.321931 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:41.322373 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:41.323106 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:41.323566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:41.324031 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:41.458925 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:41.467057 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:41.468536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:41.470199 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5bd5fa3-43dc-481e-9635-bc9c87417dd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.158971 Sep 19 17:30:41.470764 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 368/746] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:41 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:30:42.500435 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:42.501681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:42.508125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:42.508612 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:42.509054 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:42.509751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:42.510212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:42.510643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:42.638384 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:42.646963 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:42.648489 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:42.649639 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba0fc64f-a9fd-4a9f-95e4-7111c1a8bdc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.153683 Sep 19 17:30:42.650210 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 379/747] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:42 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:30:43.675735 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:43.676397 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:43.682869 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:43.683357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:43.683855 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:43.684560 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:43.685051 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:43.685481 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:43.818960 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:43.826996 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:43.828475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:43.830271 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf611573-5188-471b-8da3-6c429b917f2e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1722 microversion: 2.20 time: 0.158560 Sep 19 17:30:43.830840 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 369/748] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:43 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:30:44.856192 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:44.856808 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:44.864267 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:44.864762 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:44.865207 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:44.865916 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:44.866376 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:44.866805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:44.871430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:30:44.959656 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:44.968977 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:44.971094 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:44.973314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fdc228d6-240a-4f7a-9f2b-306e5e2cab46 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1655 microversion: 2.20 time: 0.120768 Sep 19 17:30:44.973966 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 380/749] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:44 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1655 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:30:45.001428 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-060c5175-4661-4281-aee5-b38fbe17fc54 req-a654c288-1b32-4bd8-a6f3-74410d2aceb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2eb485-3b5a-4326-bd4f-9029da4e6744", "name": "network-vif-deleted", "tag": "e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:45.013461 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-060c5175-4661-4281-aee5-b38fbe17fc54 req-a654c288-1b32-4bd8-a6f3-74410d2aceb6 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:45.013932 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-060c5175-4661-4281-aee5-b38fbe17fc54 req-a654c288-1b32-4bd8-a6f3-74410d2aceb6 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:45.014589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-060c5175-4661-4281-aee5-b38fbe17fc54 req-a654c288-1b32-4bd8-a6f3-74410d2aceb6 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:45.026732 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-060c5175-4661-4281-aee5-b38fbe17fc54 req-a654c288-1b32-4bd8-a6f3-74410d2aceb6 service nova] Creating event network-vif-deleted:e6e9e20e-f74e-4533-ba77-9c4ae4c4dc43 for instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 on hv-cinder-84801 Sep 19 17:30:45.033334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-060c5175-4661-4281-aee5-b38fbe17fc54 req-a654c288-1b32-4bd8-a6f3-74410d2aceb6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036434 Sep 19 17:30:45.033954 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 370/750] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:30:46.001412 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:46.002306 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:46.010772 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:46.011375 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:46.011908 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:46.012697 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:46.013222 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:46.013735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:46.047978 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:46.048700 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:46.049273 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:46.049731 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lazy-loading 'fault' on Instance uuid 8d2eb485-3b5a-4326-bd4f-9029da4e6744 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:30:46.102051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:46.111044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:46.112496 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:46.114295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0822576f-ea32-4d43-8b98-0522c0300927 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 200 len: 1371 microversion: 2.20 time: 0.116743 Sep 19 17:30:46.115070 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 381/751] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:45 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 1371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:30:46.504717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a32aa38-1924-4b75-9b64-3b26091bbcda tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:46.505354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a32aa38-1924-4b75-9b64-3b26091bbcda tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:46.507270 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=38 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:30:46.512255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a32aa38-1924-4b75-9b64-3b26091bbcda tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:46.512743 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a32aa38-1924-4b75-9b64-3b26091bbcda tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:46.513180 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a32aa38-1924-4b75-9b64-3b26091bbcda tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:46.513879 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a32aa38-1924-4b75-9b64-3b26091bbcda tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:46.514364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a32aa38-1924-4b75-9b64-3b26091bbcda tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:46.514794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a32aa38-1924-4b75-9b64-3b26091bbcda tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:46.602945 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:30:46.608393 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-5a32aa38-1924-4b75-9b64-3b26091bbcda tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lazy-loading 'services' on Instance uuid e33b5624-bc7c-4818-8aa5-584440fe803b {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:30:46.819230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a32aa38-1924-4b75-9b64-3b26091bbcda tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/os-volume_attachments/97805e51-5bbc-45b6-9196-1b1b21baf073" status: 202 len: 0 microversion: 2.1 time: 0.435513 Sep 19 17:30:46.819863 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 371/752] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:30:46 2022] DELETE /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/os-volume_attachments/97805e51-5bbc-45b6-9196-1b1b21baf073 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:30:47.142290 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:47.142907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:47.149504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:47.149978 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:47.150413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:47.151121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:47.151570 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:47.152020 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:47.165982 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] HTTP exception thrown: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Request method failure captured: Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 HTTP/1.1 Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKWIu8ZcFF9ScxyAL9gmWOCLMAOwgMyeN1oWftbRZnv6hH770WCtX79cGySDWWxN2V7SlIukjpwT3bDpnIYXdgr6pBpAkfD8voFe-jXCI9ZHOS4rDY4e8yAvq_36Q9x-86nhKHjiskPh7zsqwcm7J6WUJ4W5WdEHZ_Hj6uNUXa_lfcc Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 1f148193008640639adb751706133b25 Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:30:47.167567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1f148193008640639adb751706133b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1f148193008640639adb751706133b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}] Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 1f148193008640639adb751706133b25 Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 5c1fb1574d854a14bde2333da340d6a4 Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:30:47.169313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '8d2eb485-3b5a-4326-bd4f-9029da4e6744'} Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:30:47.170256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:30:47.171521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:30:47.172738 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Returning 404 to user: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:30:47.172738 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b5b8f288-4c88-4d3b-8738-31e31342c464 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 404 len: 111 microversion: 2.20 time: 0.031475 Sep 19 17:30:47.172738 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 382/753] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:47 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 17:30:47.178762 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e848f48d-a923-48a4-904d-44b97042ed6b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '.version_select at 0x7fd4d6011790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:47.261216 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e848f48d-a923-48a4-904d-44b97042ed6b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104432587" status: 204 len: 0 microversion: 2.20 time: 0.086873 Sep 19 17:30:47.261802 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 372/754] 10.222.0.61 () {60 vars in 1262 bytes} [Mon Sep 19 17:30:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104432587 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 17:30:48.022779 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-517a7526-6e97-4939-98cd-4139c8492101 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Action: 'create', calling method: .version_select at 0x7fd4d5f0f040>, body: {"keypair": {"name": "tempest-keypair-1809300722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwoPecdqeJnpimOgyGYbSZTTRL8DUO8qB9fdJv0y0/aEn5YW8mVHIOjdoqhylLvl/0aVniF+eTAIIC2B8Tuoz08kivOzDy1DO2vvlbbIAwGWKYj9N4TBrIZOT+xrNQYRQ=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:48.037803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-517a7526-6e97-4939-98cd-4139c8492101 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Getting quotas for project 1f148193008640639adb751706133b25. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:30:48.041657 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-517a7526-6e97-4939-98cd-4139c8492101 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Getting quotas for user 5c1fb1574d854a14bde2333da340d6a4 and project 1f148193008640639adb751706133b25. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:30:48.142727 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-517a7526-6e97-4939-98cd-4139c8492101 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.123121 Sep 19 17:30:48.143379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 383/755] 10.222.0.61 () {62 vars in 1200 bytes} [Mon Sep 19 17:30:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 17:30:49.009057 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-64426740-1fc1-4bd6-aec3-f6f4ac4a29e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:49.017997 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64426740-1fc1-4bd6-aec3-f6f4ac4a29e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:49.025189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64426740-1fc1-4bd6-aec3-f6f4ac4a29e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:49.025189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64426740-1fc1-4bd6-aec3-f6f4ac4a29e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:49.080700 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-64426740-1fc1-4bd6-aec3-f6f4ac4a29e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Going to try to stop instance {{(pid=121134) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 17:30:49.292406 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-64426740-1fc1-4bd6-aec3-f6f4ac4a29e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "POST /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/action" status: 202 len: 0 microversion: 2.1 time: 0.287071 Sep 19 17:30:49.293303 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 373/756] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:30:49 2022] POST /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:30:49.302045 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-396739d9-fe25-43ad-9d73-24a4c85f9233 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:49.302839 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-396739d9-fe25-43ad-9d73-24a4c85f9233 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:49.309934 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-396739d9-fe25-43ad-9d73-24a4c85f9233 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:49.310766 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-396739d9-fe25-43ad-9d73-24a4c85f9233 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:49.311217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-396739d9-fe25-43ad-9d73-24a4c85f9233 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:49.311977 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-396739d9-fe25-43ad-9d73-24a4c85f9233 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:49.312448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-396739d9-fe25-43ad-9d73-24a4c85f9233 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:49.312884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-396739d9-fe25-43ad-9d73-24a4c85f9233 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:49.519722 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-396739d9-fe25-43ad-9d73-24a4c85f9233 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:49.527678 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-396739d9-fe25-43ad-9d73-24a4c85f9233 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1678 microversion: 2.1 time: 0.230893 Sep 19 17:30:49.528267 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 384/757] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:49 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:50.358357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-508220040", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4b55d20-22b3-42fd-86ee-53a53a1c48eb"}], "security_groups": [{"name": "tempest-securitygroup--569372151"}], "key_name": "tempest-keypair-1809300722", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:50.461270 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] validate_networks() for [('a4b55d20-22b3-42fd-86ee-53a53a1c48eb', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:30:50.550594 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ca614742-a0ad-44c0-b7c9-21de92a41784 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:50.551123 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ca614742-a0ad-44c0-b7c9-21de92a41784 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:50.557797 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca614742-a0ad-44c0-b7c9-21de92a41784 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:50.558284 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca614742-a0ad-44c0-b7c9-21de92a41784 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:50.558730 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca614742-a0ad-44c0-b7c9-21de92a41784 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:50.559440 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca614742-a0ad-44c0-b7c9-21de92a41784 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:50.559940 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca614742-a0ad-44c0-b7c9-21de92a41784 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:50.560373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca614742-a0ad-44c0-b7c9-21de92a41784 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:50.731832 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ca614742-a0ad-44c0-b7c9-21de92a41784 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:50.740452 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ca614742-a0ad-44c0-b7c9-21de92a41784 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1678 microversion: 2.1 time: 0.193753 Sep 19 17:30:50.740898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 385/758] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:50 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:30:50.924924 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:30:50.925394 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:30:50.925883 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:30:50.926300 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:30:50.926715 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:30:50.936695 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:50.937213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:50.937657 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:50.939086 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:50.939581 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:50.940056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:50.962497 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Getting quotas for project 1f148193008640639adb751706133b25. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:30:50.966865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Getting quotas for user 5c1fb1574d854a14bde2333da340d6a4 and project 1f148193008640639adb751706133b25. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:30:50.981413 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:30:50.983854 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:30:51.133541 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc047617-3949-4b69-9616-43cea1340ad2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.778588 Sep 19 17:30:51.134217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 374/759] 10.222.0.61 () {62 vars in 1188 bytes} [Mon Sep 19 17:30:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 17:30:51.148157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-494275c8-7885-4802-9a07-681e6a574c83 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:51.150949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-494275c8-7885-4802-9a07-681e6a574c83 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:51.213491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-494275c8-7885-4802-9a07-681e6a574c83 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:51.221611 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-494275c8-7885-4802-9a07-681e6a574c83 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:51.223101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-494275c8-7885-4802-9a07-681e6a574c83 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:51.224370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-494275c8-7885-4802-9a07-681e6a574c83 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1281 microversion: 2.20 time: 0.081677 Sep 19 17:30:51.224847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 386/760] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:51 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:30:51.765402 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d51d0ae9-7ff1-4ebe-bf8c-2ee6f52cc069 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:51.766364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d51d0ae9-7ff1-4ebe-bf8c-2ee6f52cc069 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:51.777297 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51d0ae9-7ff1-4ebe-bf8c-2ee6f52cc069 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:51.777297 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51d0ae9-7ff1-4ebe-bf8c-2ee6f52cc069 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:51.777297 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51d0ae9-7ff1-4ebe-bf8c-2ee6f52cc069 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:51.777297 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51d0ae9-7ff1-4ebe-bf8c-2ee6f52cc069 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:51.777756 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51d0ae9-7ff1-4ebe-bf8c-2ee6f52cc069 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:51.777756 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51d0ae9-7ff1-4ebe-bf8c-2ee6f52cc069 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:51.904626 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d51d0ae9-7ff1-4ebe-bf8c-2ee6f52cc069 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:51.913679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d51d0ae9-7ff1-4ebe-bf8c-2ee6f52cc069 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1678 microversion: 2.1 time: 0.153330 Sep 19 17:30:51.914282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 375/761] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:51 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:52.249515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:52.250262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:52.256771 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:52.257271 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:52.260483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:52.260483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:52.260483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:52.260483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:52.325329 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:52.345101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:52.346558 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:52.347681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1f599f98-031c-4e1d-959c-d40c7dbcd6c8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1285 microversion: 2.20 time: 0.102153 Sep 19 17:30:52.348263 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 387/762] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:52 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:30:52.939408 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b3504569-5ff8-4c0d-b08c-de37f9317c3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:52.939995 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b3504569-5ff8-4c0d-b08c-de37f9317c3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:52.946554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3504569-5ff8-4c0d-b08c-de37f9317c3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:52.947043 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3504569-5ff8-4c0d-b08c-de37f9317c3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:52.947487 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3504569-5ff8-4c0d-b08c-de37f9317c3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:52.948215 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3504569-5ff8-4c0d-b08c-de37f9317c3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:52.948673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3504569-5ff8-4c0d-b08c-de37f9317c3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:52.949107 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3504569-5ff8-4c0d-b08c-de37f9317c3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:53.078756 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b3504569-5ff8-4c0d-b08c-de37f9317c3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:53.086466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b3504569-5ff8-4c0d-b08c-de37f9317c3e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1678 microversion: 2.1 time: 0.151632 Sep 19 17:30:53.087046 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 376/763] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:52 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:53.374153 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:53.374806 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:53.381743 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:53.382231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:53.382669 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:53.383482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:53.383984 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:53.384411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:53.453942 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:53.462603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:53.464171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:53.465472 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-692b5f75-51ad-4f24-a78a-dd15a5ca66ea tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1341 microversion: 2.20 time: 0.095835 Sep 19 17:30:53.467160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 388/764] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:53 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1341 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:30:54.110330 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-abbace15-1812-471c-9035-88587f2b022c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:54.111185 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-abbace15-1812-471c-9035-88587f2b022c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:54.118368 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbace15-1812-471c-9035-88587f2b022c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:54.118903 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbace15-1812-471c-9035-88587f2b022c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:54.119346 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbace15-1812-471c-9035-88587f2b022c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:54.120103 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbace15-1812-471c-9035-88587f2b022c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:54.120623 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbace15-1812-471c-9035-88587f2b022c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:54.121057 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbace15-1812-471c-9035-88587f2b022c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:54.433522 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-abbace15-1812-471c-9035-88587f2b022c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:54.442035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-abbace15-1812-471c-9035-88587f2b022c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1678 microversion: 2.1 time: 0.335701 Sep 19 17:30:54.442906 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 377/765] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:54 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1678 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:54.498842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:54.498842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:54.508875 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:54.510038 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:54.510502 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:54.511258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:54.511746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:54.512249 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:54.682980 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:54.689327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:54.690815 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:54.693026 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fd60214c-b6f9-4766-9680-4105cf9e8ac2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1406 microversion: 2.20 time: 0.205042 Sep 19 17:30:54.693924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 389/766] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:54 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:30:55.466641 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da1daa4e-2a1c-4610-81ab-351b6de73459 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:55.467237 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-da1daa4e-2a1c-4610-81ab-351b6de73459 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:55.474035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da1daa4e-2a1c-4610-81ab-351b6de73459 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:55.474560 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da1daa4e-2a1c-4610-81ab-351b6de73459 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:55.475016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da1daa4e-2a1c-4610-81ab-351b6de73459 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:55.476177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da1daa4e-2a1c-4610-81ab-351b6de73459 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:55.476321 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da1daa4e-2a1c-4610-81ab-351b6de73459 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:55.476687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da1daa4e-2a1c-4610-81ab-351b6de73459 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:55.565277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6df8c37b-cc0f-4fed-851d-81c1298adaff req-6dfa11d1-ef82-4eb2-8ff7-d922c174dafe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70bea192-300a-4359-90a1-81ad16a35d10", "tag": "11cb86d3-62be-4d60-8b1e-e8a216766190"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:30:55.575537 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6df8c37b-cc0f-4fed-851d-81c1298adaff req-6dfa11d1-ef82-4eb2-8ff7-d922c174dafe service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:55.576046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6df8c37b-cc0f-4fed-851d-81c1298adaff req-6dfa11d1-ef82-4eb2-8ff7-d922c174dafe service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:55.576470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6df8c37b-cc0f-4fed-851d-81c1298adaff req-6dfa11d1-ef82-4eb2-8ff7-d922c174dafe service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:55.587854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6df8c37b-cc0f-4fed-851d-81c1298adaff req-6dfa11d1-ef82-4eb2-8ff7-d922c174dafe service nova] Creating event network-changed:11cb86d3-62be-4d60-8b1e-e8a216766190 for instance 70bea192-300a-4359-90a1-81ad16a35d10 on hv-cinder-84801 Sep 19 17:30:55.593147 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6df8c37b-cc0f-4fed-851d-81c1298adaff req-6dfa11d1-ef82-4eb2-8ff7-d922c174dafe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031681 Sep 19 17:30:55.594945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 390/767] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:30:55.713627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-da1daa4e-2a1c-4610-81ab-351b6de73459 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:55.719812 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:55.720887 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:55.724919 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da1daa4e-2a1c-4610-81ab-351b6de73459 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1678 microversion: 2.1 time: 0.262113 Sep 19 17:30:55.725666 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 378/768] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:55 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1678 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:30:55.728361 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:55.728860 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:55.729300 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:55.730019 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:55.730476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:55.730904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:56.029126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:56.040237 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:56.041738 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:56.042888 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7984e16b-fe3f-446f-aa64-e7d0ab0bba6c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1406 microversion: 2.20 time: 0.328036 Sep 19 17:30:56.043713 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 391/769] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:55 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:30:56.749119 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-05381d33-2131-4289-8500-ff135b64e8ae tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:56.749759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-05381d33-2131-4289-8500-ff135b64e8ae tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:56.756757 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05381d33-2131-4289-8500-ff135b64e8ae tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:56.757236 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05381d33-2131-4289-8500-ff135b64e8ae tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:56.757676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05381d33-2131-4289-8500-ff135b64e8ae tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:56.758366 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05381d33-2131-4289-8500-ff135b64e8ae tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:56.758821 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05381d33-2131-4289-8500-ff135b64e8ae tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:56.759247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05381d33-2131-4289-8500-ff135b64e8ae tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:56.890398 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-05381d33-2131-4289-8500-ff135b64e8ae tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:56.898520 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-05381d33-2131-4289-8500-ff135b64e8ae tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1678 microversion: 2.1 time: 0.153319 Sep 19 17:30:56.899013 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 379/770] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:56 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:30:57.067737 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:57.068482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:57.074938 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:57.075424 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:57.075899 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:57.076602 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:57.077061 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:57.077490 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:57.210841 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:57.218937 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:57.220889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:57.221996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09932137-66e1-467f-a66d-c61696408c0a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1406 microversion: 2.20 time: 0.158189 Sep 19 17:30:57.222549 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 392/771] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:57 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:30:57.921698 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-352c6d50-0fd5-4806-9eb1-7acf09502ff6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:57.922291 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-352c6d50-0fd5-4806-9eb1-7acf09502ff6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:57.928683 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352c6d50-0fd5-4806-9eb1-7acf09502ff6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:57.929162 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352c6d50-0fd5-4806-9eb1-7acf09502ff6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:57.929596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352c6d50-0fd5-4806-9eb1-7acf09502ff6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:57.930275 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352c6d50-0fd5-4806-9eb1-7acf09502ff6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:57.930724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352c6d50-0fd5-4806-9eb1-7acf09502ff6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:57.931168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-352c6d50-0fd5-4806-9eb1-7acf09502ff6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:58.061168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-352c6d50-0fd5-4806-9eb1-7acf09502ff6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:58.069643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-352c6d50-0fd5-4806-9eb1-7acf09502ff6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1678 microversion: 2.1 time: 0.151839 Sep 19 17:30:58.071369 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 380/772] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:57 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:58.247465 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:58.248108 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:58.255295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:58.255817 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:58.256307 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:58.256999 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:58.257450 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:58.257879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:58.389471 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:58.397802 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:58.399232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:58.400370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7cd5b1d4-6d05-44e8-9356-1823998b7a68 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1406 microversion: 2.20 time: 0.156958 Sep 19 17:30:58.400941 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 393/773] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:58 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:30:59.092964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aa52d2ca-22ed-4363-a72a-c081c1ceed60 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:59.093580 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aa52d2ca-22ed-4363-a72a-c081c1ceed60 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:59.101067 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa52d2ca-22ed-4363-a72a-c081c1ceed60 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:59.101552 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa52d2ca-22ed-4363-a72a-c081c1ceed60 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:59.101989 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa52d2ca-22ed-4363-a72a-c081c1ceed60 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:59.102712 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa52d2ca-22ed-4363-a72a-c081c1ceed60 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:59.103166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa52d2ca-22ed-4363-a72a-c081c1ceed60 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:59.103588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa52d2ca-22ed-4363-a72a-c081c1ceed60 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:59.229470 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-aa52d2ca-22ed-4363-a72a-c081c1ceed60 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:59.237379 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aa52d2ca-22ed-4363-a72a-c081c1ceed60 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1678 microversion: 2.1 time: 0.148206 Sep 19 17:30:59.237864 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 381/774] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:30:59 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:30:59.426106 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:30:59.426711 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:30:59.433219 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:59.433703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:59.434138 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:59.434839 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:30:59.435291 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:30:59.435798 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:30:59.562996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:59.571094 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:59.572607 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:30:59.573712 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f05aa801-a7bd-4a25-b274-08c3c8d4085f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1406 microversion: 2.20 time: 0.151652 Sep 19 17:30:59.574270 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 394/775] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:30:59 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:31:00.261385 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e43cc45c-6018-4b32-943d-ced4221513cf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:00.261979 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e43cc45c-6018-4b32-943d-ced4221513cf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:00.269558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43cc45c-6018-4b32-943d-ced4221513cf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:00.270118 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43cc45c-6018-4b32-943d-ced4221513cf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:00.270557 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43cc45c-6018-4b32-943d-ced4221513cf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:00.271246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43cc45c-6018-4b32-943d-ced4221513cf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:00.271716 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43cc45c-6018-4b32-943d-ced4221513cf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:00.272147 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43cc45c-6018-4b32-943d-ced4221513cf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:00.405826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e43cc45c-6018-4b32-943d-ced4221513cf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:00.413873 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e43cc45c-6018-4b32-943d-ced4221513cf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1678 microversion: 2.1 time: 0.156324 Sep 19 17:31:00.414452 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 382/776] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:00 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:00.598541 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:00.599229 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:00.605930 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:00.606447 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:00.606889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:00.607587 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:00.608063 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:00.608488 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:00.737058 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:00.746007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:00.747522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:00.748673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0809315b-52ec-4154-8ad1-a6af432a81be tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1406 microversion: 2.20 time: 0.154149 Sep 19 17:31:00.751141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 395/777] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:31:00 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:31:01.438115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3c31af75-5763-4e94-80e5-09f7c48ec8b7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:01.438759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3c31af75-5763-4e94-80e5-09f7c48ec8b7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:01.440734 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:01.441413 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:01.447349 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c31af75-5763-4e94-80e5-09f7c48ec8b7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:01.447941 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c31af75-5763-4e94-80e5-09f7c48ec8b7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:01.453834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c31af75-5763-4e94-80e5-09f7c48ec8b7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:01.453834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c31af75-5763-4e94-80e5-09f7c48ec8b7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:01.453834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c31af75-5763-4e94-80e5-09f7c48ec8b7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:01.453834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c31af75-5763-4e94-80e5-09f7c48ec8b7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:01.586228 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3c31af75-5763-4e94-80e5-09f7c48ec8b7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:01.593984 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3c31af75-5763-4e94-80e5-09f7c48ec8b7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1655 microversion: 2.1 time: 0.159915 Sep 19 17:31:01.594606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 383/778] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:01 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:01.616706 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3c37b9a9-bead-45ac-8ddf-1c0fccba30eb tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:31:01.618636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:01.623875 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c37b9a9-bead-45ac-8ddf-1c0fccba30eb tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:01.624358 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c37b9a9-bead-45ac-8ddf-1c0fccba30eb tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:01.624791 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c37b9a9-bead-45ac-8ddf-1c0fccba30eb tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:01.648724 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3c37b9a9-bead-45ac-8ddf-1c0fccba30eb tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Going to try to start instance {{(pid=121135) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 17:31:01.775898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:01.776521 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:01.782872 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:01.783228 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:01.783670 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:01.784403 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:01.784885 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:01.788295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:01.908884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3c37b9a9-bead-45ac-8ddf-1c0fccba30eb tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "POST /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/action" status: 202 len: 0 microversion: 2.1 time: 0.295754 Sep 19 17:31:01.909755 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 396/779] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:31:01 2022] POST /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 17:31:01.917279 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:01.925757 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:01.927188 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:01.927676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8e48d4a7-aab1-4ceb-9e57-d26e68299283 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:01.928859 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cfa0b4fe-ac0f-4a26-8616-999064e41545 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1406 microversion: 2.20 time: 0.157846 Sep 19 17:31:01.928997 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8e48d4a7-aab1-4ceb-9e57-d26e68299283 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:01.944268 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 384/780] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:31:01 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:31:01.944506 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e48d4a7-aab1-4ceb-9e57-d26e68299283 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:01.944506 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e48d4a7-aab1-4ceb-9e57-d26e68299283 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:01.944506 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e48d4a7-aab1-4ceb-9e57-d26e68299283 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:01.944506 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e48d4a7-aab1-4ceb-9e57-d26e68299283 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:01.944870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e48d4a7-aab1-4ceb-9e57-d26e68299283 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:01.944870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e48d4a7-aab1-4ceb-9e57-d26e68299283 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:02.072948 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8e48d4a7-aab1-4ceb-9e57-d26e68299283 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:02.081046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8e48d4a7-aab1-4ceb-9e57-d26e68299283 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1664 microversion: 2.1 time: 0.166797 Sep 19 17:31:02.081614 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 397/781] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:01 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:02.955869 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:02.956475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:02.962899 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:02.963381 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:02.963850 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:02.964533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:02.964983 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:02.965455 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:03.093995 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:03.102548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:03.104029 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:03.104154 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f8cce161-e64f-4801-b35b-ac8385a04046 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:03.104842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f8cce161-e64f-4801-b35b-ac8385a04046 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:03.105207 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aa746742-c980-4a56-b182-538f8000bc26 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1406 microversion: 2.20 time: 0.153327 Sep 19 17:31:03.105772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 385/782] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:31:02 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:31:03.111120 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8cce161-e64f-4801-b35b-ac8385a04046 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:03.111605 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8cce161-e64f-4801-b35b-ac8385a04046 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:03.112078 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8cce161-e64f-4801-b35b-ac8385a04046 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:03.112779 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8cce161-e64f-4801-b35b-ac8385a04046 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:03.113240 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8cce161-e64f-4801-b35b-ac8385a04046 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:03.113663 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8cce161-e64f-4801-b35b-ac8385a04046 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:03.242483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f8cce161-e64f-4801-b35b-ac8385a04046 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:03.244850 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:03.251016 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f8cce161-e64f-4801-b35b-ac8385a04046 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1664 microversion: 2.1 time: 0.150793 Sep 19 17:31:03.264925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 398/783] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:03 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:31:04.130659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:04.131408 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:04.138750 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:04.139277 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:04.139848 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:04.140464 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:04.141172 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:04.141606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:04.166737 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-2245794c-b438-44b7-8f19-b9626c9e7226 req-a40c01e0-bb81-4bc6-bc4d-aea14d8be2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bea192-300a-4359-90a1-81ad16a35d10", "name": "network-vif-plugged", "status": "completed", "tag": "11cb86d3-62be-4d60-8b1e-e8a216766190"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:31:04.178046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2245794c-b438-44b7-8f19-b9626c9e7226 req-a40c01e0-bb81-4bc6-bc4d-aea14d8be2a6 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:04.178525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2245794c-b438-44b7-8f19-b9626c9e7226 req-a40c01e0-bb81-4bc6-bc4d-aea14d8be2a6 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:04.178964 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2245794c-b438-44b7-8f19-b9626c9e7226 req-a40c01e0-bb81-4bc6-bc4d-aea14d8be2a6 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:04.190530 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-2245794c-b438-44b7-8f19-b9626c9e7226 req-a40c01e0-bb81-4bc6-bc4d-aea14d8be2a6 service nova] Creating event network-vif-plugged:11cb86d3-62be-4d60-8b1e-e8a216766190 for instance 70bea192-300a-4359-90a1-81ad16a35d10 on hv-cinder-84801 Sep 19 17:31:04.195778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-2245794c-b438-44b7-8f19-b9626c9e7226 req-a40c01e0-bb81-4bc6-bc4d-aea14d8be2a6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034578 Sep 19 17:31:04.196394 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 399/784] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:31:04.286773 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:04.288911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-333aaa79-b139-49ff-97f6-16df9960df52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:04.289738 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-333aaa79-b139-49ff-97f6-16df9960df52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:04.296685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-333aaa79-b139-49ff-97f6-16df9960df52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:04.297598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-333aaa79-b139-49ff-97f6-16df9960df52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:04.297757 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-333aaa79-b139-49ff-97f6-16df9960df52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:04.298360 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-333aaa79-b139-49ff-97f6-16df9960df52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:04.298802 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-333aaa79-b139-49ff-97f6-16df9960df52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:04.299226 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-333aaa79-b139-49ff-97f6-16df9960df52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:04.304938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:04.306394 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:04.307924 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c1467279-ffc4-40f4-a115-55f34deee877 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1406 microversion: 2.20 time: 0.181351 Sep 19 17:31:04.308497 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 386/785] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:31:04 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:31:04.432579 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-333aaa79-b139-49ff-97f6-16df9960df52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:04.440425 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-333aaa79-b139-49ff-97f6-16df9960df52 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1668 microversion: 2.1 time: 0.157631 Sep 19 17:31:04.441036 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 400/786] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:04 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:31:05.333384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:05.333985 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:05.340472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:05.340948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:05.341380 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:05.342065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:05.342514 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:05.343091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:05.474822 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:05.483572 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:05.485145 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:05.486378 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-786d7da1-1ae7-46cd-9ce4-96d5937effd3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1406 microversion: 2.20 time: 0.156880 Sep 19 17:31:05.486950 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 387/787] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:31:05 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:31:06.268663 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-003d176c-7db8-4232-b636-d416741f2c2d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:31:06.269289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-003d176c-7db8-4232-b636-d416741f2c2d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:06.275960 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003d176c-7db8-4232-b636-d416741f2c2d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:06.276444 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003d176c-7db8-4232-b636-d416741f2c2d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:06.276881 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003d176c-7db8-4232-b636-d416741f2c2d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:06.277576 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003d176c-7db8-4232-b636-d416741f2c2d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:06.278035 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003d176c-7db8-4232-b636-d416741f2c2d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:06.278463 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003d176c-7db8-4232-b636-d416741f2c2d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:06.301470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-003d176c-7db8-4232-b636-d416741f2c2d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lazy-loading 'flavor' on Instance uuid 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:31:06.510609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:06.511171 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:06.519246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:06.519768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:06.520222 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:06.520976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:06.521417 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:06.521845 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:06.538070 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:06.653901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:06.654105 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-003d176c-7db8-4232-b636-d416741f2c2d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "POST /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046/action" status: 202 len: 0 microversion: 2.1 time: 0.389480 Sep 19 17:31:06.654644 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 401/788] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:31:06 2022] POST /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:31:06.662417 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:06.663262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e28a605-aecd-4972-aba1-b6a7fab440b0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:06.663888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:06.664163 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1e28a605-aecd-4972-aba1-b6a7fab440b0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:06.665027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d6e5d38-8e1f-4496-8919-7dee38be86a7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1406 microversion: 2.20 time: 0.158472 Sep 19 17:31:06.665769 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 388/789] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:31:06 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:31:06.673059 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e28a605-aecd-4972-aba1-b6a7fab440b0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:06.673597 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e28a605-aecd-4972-aba1-b6a7fab440b0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:06.674035 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e28a605-aecd-4972-aba1-b6a7fab440b0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:06.674735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e28a605-aecd-4972-aba1-b6a7fab440b0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:06.675372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e28a605-aecd-4972-aba1-b6a7fab440b0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:06.675933 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e28a605-aecd-4972-aba1-b6a7fab440b0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:06.813454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1e28a605-aecd-4972-aba1-b6a7fab440b0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:06.821241 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e28a605-aecd-4972-aba1-b6a7fab440b0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.162169 Sep 19 17:31:06.822312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 402/790] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:06 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:07.690676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:07.691233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:07.697980 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:07.698472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:07.698917 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:07.699615 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:07.700158 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:07.700594 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:07.828883 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:07.837283 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:07.839330 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:07.840783 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf862648-94a2-44ef-bc5a-5bfb7a0ff3f8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1598 microversion: 2.20 time: 0.154597 Sep 19 17:31:07.841662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 389/791] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:31:07 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:31:07.845242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5b04cc81-893b-44fd-b682-167acbd3ec28 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:07.845853 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5b04cc81-893b-44fd-b682-167acbd3ec28 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:07.852416 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b04cc81-893b-44fd-b682-167acbd3ec28 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:07.853001 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b04cc81-893b-44fd-b682-167acbd3ec28 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:07.854435 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b04cc81-893b-44fd-b682-167acbd3ec28 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:07.854886 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b04cc81-893b-44fd-b682-167acbd3ec28 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:07.855337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b04cc81-893b-44fd-b682-167acbd3ec28 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:07.855918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b04cc81-893b-44fd-b682-167acbd3ec28 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:07.865794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-911e15bb-28d5-4158-96a4-b93ae88dcb3f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:07.866292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-911e15bb-28d5-4158-96a4-b93ae88dcb3f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:07.872188 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-911e15bb-28d5-4158-96a4-b93ae88dcb3f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:07.872679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-911e15bb-28d5-4158-96a4-b93ae88dcb3f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:07.873114 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-911e15bb-28d5-4158-96a4-b93ae88dcb3f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:07.873815 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-911e15bb-28d5-4158-96a4-b93ae88dcb3f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:07.874306 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-911e15bb-28d5-4158-96a4-b93ae88dcb3f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:07.874730 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-911e15bb-28d5-4158-96a4-b93ae88dcb3f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:07.987523 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-911e15bb-28d5-4158-96a4-b93ae88dcb3f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.125484 Sep 19 17:31:07.988384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 390/792] 10.222.0.61 () {60 vars in 1316 bytes} [Mon Sep 19 17:31:07 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 17:31:08.323001 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5b04cc81-893b-44fd-b682-167acbd3ec28 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:08.330875 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5b04cc81-893b-44fd-b682-167acbd3ec28 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.489609 Sep 19 17:31:08.331668 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 403/793] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:07 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:09.210461 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-abdb1a13-225c-4db4-89e2-c74d49539356 req-ed729f41-f0d8-43d9-ba31-5b62c780be15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70bea192-300a-4359-90a1-81ad16a35d10", "tag": "11cb86d3-62be-4d60-8b1e-e8a216766190"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:31:09.220930 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-abdb1a13-225c-4db4-89e2-c74d49539356 req-ed729f41-f0d8-43d9-ba31-5b62c780be15 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:09.221416 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-abdb1a13-225c-4db4-89e2-c74d49539356 req-ed729f41-f0d8-43d9-ba31-5b62c780be15 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:09.221856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-abdb1a13-225c-4db4-89e2-c74d49539356 req-ed729f41-f0d8-43d9-ba31-5b62c780be15 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:09.234187 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-abdb1a13-225c-4db4-89e2-c74d49539356 req-ed729f41-f0d8-43d9-ba31-5b62c780be15 service nova] Creating event network-changed:11cb86d3-62be-4d60-8b1e-e8a216766190 for instance 70bea192-300a-4359-90a1-81ad16a35d10 on hv-cinder-84801 Sep 19 17:31:09.239424 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-abdb1a13-225c-4db4-89e2-c74d49539356 req-ed729f41-f0d8-43d9-ba31-5b62c780be15 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033170 Sep 19 17:31:09.240314 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 391/794] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:31:09.355127 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e26464d-7b87-4411-be5a-b0d950629ba0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:09.356440 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e26464d-7b87-4411-be5a-b0d950629ba0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:09.358906 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:09.365601 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e26464d-7b87-4411-be5a-b0d950629ba0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:09.366442 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e26464d-7b87-4411-be5a-b0d950629ba0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:09.367148 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e26464d-7b87-4411-be5a-b0d950629ba0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:09.367974 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e26464d-7b87-4411-be5a-b0d950629ba0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:09.370999 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e26464d-7b87-4411-be5a-b0d950629ba0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:09.376475 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e26464d-7b87-4411-be5a-b0d950629ba0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:09.586021 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2e26464d-7b87-4411-be5a-b0d950629ba0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:09.594545 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e26464d-7b87-4411-be5a-b0d950629ba0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.243830 Sep 19 17:31:09.595208 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 404/795] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:09 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:10.619245 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5a46297-8013-46fc-9beb-d74b08c15e56 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:10.620004 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a5a46297-8013-46fc-9beb-d74b08c15e56 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:10.626627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5a46297-8013-46fc-9beb-d74b08c15e56 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:10.627109 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5a46297-8013-46fc-9beb-d74b08c15e56 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:10.627548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5a46297-8013-46fc-9beb-d74b08c15e56 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:10.628261 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5a46297-8013-46fc-9beb-d74b08c15e56 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:10.628721 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5a46297-8013-46fc-9beb-d74b08c15e56 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:10.629145 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5a46297-8013-46fc-9beb-d74b08c15e56 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:10.761342 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a5a46297-8013-46fc-9beb-d74b08c15e56 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:10.769393 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5a46297-8013-46fc-9beb-d74b08c15e56 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.155024 Sep 19 17:31:10.769954 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 392/796] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:10 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:11.793720 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2da1ae08-bce2-4f93-80c3-0f3e71a1312e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:11.794429 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2da1ae08-bce2-4f93-80c3-0f3e71a1312e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:11.801090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da1ae08-bce2-4f93-80c3-0f3e71a1312e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:11.801570 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da1ae08-bce2-4f93-80c3-0f3e71a1312e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:11.802003 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da1ae08-bce2-4f93-80c3-0f3e71a1312e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:11.802702 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da1ae08-bce2-4f93-80c3-0f3e71a1312e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:11.803260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da1ae08-bce2-4f93-80c3-0f3e71a1312e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:11.803685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da1ae08-bce2-4f93-80c3-0f3e71a1312e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:11.938051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2da1ae08-bce2-4f93-80c3-0f3e71a1312e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:11.945998 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2da1ae08-bce2-4f93-80c3-0f3e71a1312e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.156688 Sep 19 17:31:11.946576 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 405/797] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:11 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:12.969380 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed208838-9b32-430e-bf21-2f32b692cb14 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:12.969988 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed208838-9b32-430e-bf21-2f32b692cb14 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:12.976693 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed208838-9b32-430e-bf21-2f32b692cb14 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:12.977529 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed208838-9b32-430e-bf21-2f32b692cb14 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:12.978202 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed208838-9b32-430e-bf21-2f32b692cb14 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:12.978946 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed208838-9b32-430e-bf21-2f32b692cb14 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:12.979398 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed208838-9b32-430e-bf21-2f32b692cb14 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:12.979861 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed208838-9b32-430e-bf21-2f32b692cb14 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:13.118301 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed208838-9b32-430e-bf21-2f32b692cb14 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:13.126775 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed208838-9b32-430e-bf21-2f32b692cb14 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.161269 Sep 19 17:31:13.127348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 393/798] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:12 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:14.150715 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-edec4cdb-d0fa-4a9e-ba3c-55705a7983c3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:14.151861 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-edec4cdb-d0fa-4a9e-ba3c-55705a7983c3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:14.158350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edec4cdb-d0fa-4a9e-ba3c-55705a7983c3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:14.158828 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edec4cdb-d0fa-4a9e-ba3c-55705a7983c3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:14.159260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edec4cdb-d0fa-4a9e-ba3c-55705a7983c3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:14.159973 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edec4cdb-d0fa-4a9e-ba3c-55705a7983c3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:14.160431 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edec4cdb-d0fa-4a9e-ba3c-55705a7983c3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:14.160852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edec4cdb-d0fa-4a9e-ba3c-55705a7983c3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:14.292415 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-edec4cdb-d0fa-4a9e-ba3c-55705a7983c3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:14.300239 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-edec4cdb-d0fa-4a9e-ba3c-55705a7983c3 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.153704 Sep 19 17:31:14.300810 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 406/799] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:14 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:15.324416 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e459b387-3954-411d-a22e-32e1286ffc4b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:15.325027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e459b387-3954-411d-a22e-32e1286ffc4b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:15.331933 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e459b387-3954-411d-a22e-32e1286ffc4b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:15.332442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e459b387-3954-411d-a22e-32e1286ffc4b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:15.332864 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e459b387-3954-411d-a22e-32e1286ffc4b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:15.333562 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e459b387-3954-411d-a22e-32e1286ffc4b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:15.334021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e459b387-3954-411d-a22e-32e1286ffc4b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:15.334450 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e459b387-3954-411d-a22e-32e1286ffc4b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:15.463752 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e459b387-3954-411d-a22e-32e1286ffc4b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:15.471680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e459b387-3954-411d-a22e-32e1286ffc4b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.151319 Sep 19 17:31:15.472283 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 394/800] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:15 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:16.495610 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ebf5c85e-5658-462b-bca8-b3b98870630e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:16.496764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ebf5c85e-5658-462b-bca8-b3b98870630e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:16.503298 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebf5c85e-5658-462b-bca8-b3b98870630e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:16.503933 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebf5c85e-5658-462b-bca8-b3b98870630e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:16.504378 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebf5c85e-5658-462b-bca8-b3b98870630e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:16.505079 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebf5c85e-5658-462b-bca8-b3b98870630e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:16.505540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebf5c85e-5658-462b-bca8-b3b98870630e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:16.505964 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebf5c85e-5658-462b-bca8-b3b98870630e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:16.638048 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebf5c85e-5658-462b-bca8-b3b98870630e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:16.646044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ebf5c85e-5658-462b-bca8-b3b98870630e tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.154423 Sep 19 17:31:16.646612 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 407/801] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:16 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:17.669679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85cb2189-be13-45f2-ad9c-3f6282ff9021 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:17.670276 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85cb2189-be13-45f2-ad9c-3f6282ff9021 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:17.672819 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:17.679951 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85cb2189-be13-45f2-ad9c-3f6282ff9021 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:17.679951 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85cb2189-be13-45f2-ad9c-3f6282ff9021 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:17.679951 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85cb2189-be13-45f2-ad9c-3f6282ff9021 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:17.679951 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85cb2189-be13-45f2-ad9c-3f6282ff9021 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:17.680300 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85cb2189-be13-45f2-ad9c-3f6282ff9021 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:17.680300 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85cb2189-be13-45f2-ad9c-3f6282ff9021 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:17.881786 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-85cb2189-be13-45f2-ad9c-3f6282ff9021 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:17.889987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85cb2189-be13-45f2-ad9c-3f6282ff9021 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.224241 Sep 19 17:31:17.890606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 395/802] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:17 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:18.913672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f90374e0-5b79-4f62-a2f0-424dca1aaaa4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:18.914306 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f90374e0-5b79-4f62-a2f0-424dca1aaaa4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:18.921255 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90374e0-5b79-4f62-a2f0-424dca1aaaa4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:18.921751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90374e0-5b79-4f62-a2f0-424dca1aaaa4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:18.922199 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90374e0-5b79-4f62-a2f0-424dca1aaaa4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:18.922907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90374e0-5b79-4f62-a2f0-424dca1aaaa4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:18.923367 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90374e0-5b79-4f62-a2f0-424dca1aaaa4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:18.923821 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90374e0-5b79-4f62-a2f0-424dca1aaaa4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:19.061483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f90374e0-5b79-4f62-a2f0-424dca1aaaa4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:19.069281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f90374e0-5b79-4f62-a2f0-424dca1aaaa4 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.159518 Sep 19 17:31:19.069856 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 408/803] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:18 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:20.093382 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d44d61f-e97b-4b96-a5bf-4066d1794695 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:20.093975 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d44d61f-e97b-4b96-a5bf-4066d1794695 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:20.100019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d44d61f-e97b-4b96-a5bf-4066d1794695 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:20.100504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d44d61f-e97b-4b96-a5bf-4066d1794695 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:20.100941 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d44d61f-e97b-4b96-a5bf-4066d1794695 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:20.101645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d44d61f-e97b-4b96-a5bf-4066d1794695 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:20.102088 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d44d61f-e97b-4b96-a5bf-4066d1794695 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:20.102528 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d44d61f-e97b-4b96-a5bf-4066d1794695 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:20.231905 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d44d61f-e97b-4b96-a5bf-4066d1794695 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:20.240022 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d44d61f-e97b-4b96-a5bf-4066d1794695 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.151299 Sep 19 17:31:20.240601 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 396/804] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:20 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:21.262542 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c013193e-bd3e-4281-8fc0-0c84ddea2479 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:21.263092 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c013193e-bd3e-4281-8fc0-0c84ddea2479 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:21.269731 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c013193e-bd3e-4281-8fc0-0c84ddea2479 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:21.270171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c013193e-bd3e-4281-8fc0-0c84ddea2479 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:21.270615 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c013193e-bd3e-4281-8fc0-0c84ddea2479 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:21.271313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c013193e-bd3e-4281-8fc0-0c84ddea2479 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:21.271794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c013193e-bd3e-4281-8fc0-0c84ddea2479 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:21.272222 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c013193e-bd3e-4281-8fc0-0c84ddea2479 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:21.407036 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c013193e-bd3e-4281-8fc0-0c84ddea2479 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:21.414813 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c013193e-bd3e-4281-8fc0-0c84ddea2479 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.156297 Sep 19 17:31:21.415383 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 409/805] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:21 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:22.439932 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21b484b9-907a-4a9c-9d32-166656718b4d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:22.441387 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21b484b9-907a-4a9c-9d32-166656718b4d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:22.449138 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b484b9-907a-4a9c-9d32-166656718b4d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:22.449659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b484b9-907a-4a9c-9d32-166656718b4d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:22.450142 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b484b9-907a-4a9c-9d32-166656718b4d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:22.450836 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b484b9-907a-4a9c-9d32-166656718b4d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:22.451350 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b484b9-907a-4a9c-9d32-166656718b4d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:22.451822 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b484b9-907a-4a9c-9d32-166656718b4d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:22.586576 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-21b484b9-907a-4a9c-9d32-166656718b4d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:22.594892 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21b484b9-907a-4a9c-9d32-166656718b4d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1570 microversion: 2.1 time: 0.160529 Sep 19 17:31:22.595493 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 397/806] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:22 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:22.618568 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f25e400-9ccb-476d-af16-579dbb444af6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:31:22.619115 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f25e400-9ccb-476d-af16-579dbb444af6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:22.625415 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f25e400-9ccb-476d-af16-579dbb444af6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:22.625878 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f25e400-9ccb-476d-af16-579dbb444af6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:22.626310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f25e400-9ccb-476d-af16-579dbb444af6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:22.627002 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f25e400-9ccb-476d-af16-579dbb444af6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:22.627457 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f25e400-9ccb-476d-af16-579dbb444af6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:22.627918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f25e400-9ccb-476d-af16-579dbb444af6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:22.658293 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f25e400-9ccb-476d-af16-579dbb444af6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121135) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 17:31:22.929912 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f25e400-9ccb-476d-af16-579dbb444af6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "POST /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046/action" status: 202 len: 0 microversion: 2.1 time: 0.315178 Sep 19 17:31:22.930450 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 410/807] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:31:22 2022] POST /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:31:22.938656 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-855dcb3d-f31a-45d8-b21a-935f8257a8f8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:22.939385 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-855dcb3d-f31a-45d8-b21a-935f8257a8f8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:22.945717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-855dcb3d-f31a-45d8-b21a-935f8257a8f8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:22.950717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-855dcb3d-f31a-45d8-b21a-935f8257a8f8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:22.950717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-855dcb3d-f31a-45d8-b21a-935f8257a8f8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:22.950717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-855dcb3d-f31a-45d8-b21a-935f8257a8f8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:22.950717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-855dcb3d-f31a-45d8-b21a-935f8257a8f8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:22.951120 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-855dcb3d-f31a-45d8-b21a-935f8257a8f8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:23.085691 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-855dcb3d-f31a-45d8-b21a-935f8257a8f8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:23.094334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-855dcb3d-f31a-45d8-b21a-935f8257a8f8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1518 microversion: 2.1 time: 0.159509 Sep 19 17:31:23.094908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 398/808] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:22 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:24.118202 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-104d3094-6335-42b4-8a5c-01a5887a5682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:24.120792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-104d3094-6335-42b4-8a5c-01a5887a5682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:24.126468 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-104d3094-6335-42b4-8a5c-01a5887a5682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:24.127296 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-104d3094-6335-42b4-8a5c-01a5887a5682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:24.128014 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-104d3094-6335-42b4-8a5c-01a5887a5682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:24.128812 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-104d3094-6335-42b4-8a5c-01a5887a5682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:24.129377 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-104d3094-6335-42b4-8a5c-01a5887a5682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:24.129863 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-104d3094-6335-42b4-8a5c-01a5887a5682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:24.198567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0556e933-b7b9-4156-83ba-826fb7e46bdd req-8d480443-75c3-4712-9067-366cc7037c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9442149d-db6c-4fd9-b92a-3eaf3e8c2046", "name": "network-vif-unplugged", "status": "completed", "tag": "ddae7d4a-71c6-4777-a374-39594620566f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:31:24.216340 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0556e933-b7b9-4156-83ba-826fb7e46bdd req-8d480443-75c3-4712-9067-366cc7037c4a service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:24.216825 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0556e933-b7b9-4156-83ba-826fb7e46bdd req-8d480443-75c3-4712-9067-366cc7037c4a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:24.217249 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0556e933-b7b9-4156-83ba-826fb7e46bdd req-8d480443-75c3-4712-9067-366cc7037c4a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:24.229551 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.server_external_events [req-0556e933-b7b9-4156-83ba-826fb7e46bdd req-8d480443-75c3-4712-9067-366cc7037c4a service nova] Unable to find a host for instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046. Dropping event network-vif-unplugged {{(pid=121134) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 17:31:24.230512 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0556e933-b7b9-4156-83ba-826fb7e46bdd req-8d480443-75c3-4712-9067-366cc7037c4a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035797 Sep 19 17:31:24.231088 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 399/809] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 19 17:31:24.272371 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-104d3094-6335-42b4-8a5c-01a5887a5682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:24.280412 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-104d3094-6335-42b4-8a5c-01a5887a5682 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1518 microversion: 2.1 time: 0.166749 Sep 19 17:31:24.281171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 411/810] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:24 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:25.303498 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ba6e862-0272-4a53-a49c-4a5b9ba97147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:25.304379 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3ba6e862-0272-4a53-a49c-4a5b9ba97147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:25.310951 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba6e862-0272-4a53-a49c-4a5b9ba97147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:25.312041 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba6e862-0272-4a53-a49c-4a5b9ba97147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:25.315508 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba6e862-0272-4a53-a49c-4a5b9ba97147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:25.315508 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba6e862-0272-4a53-a49c-4a5b9ba97147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:25.315508 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba6e862-0272-4a53-a49c-4a5b9ba97147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:25.315508 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba6e862-0272-4a53-a49c-4a5b9ba97147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:25.453886 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ba6e862-0272-4a53-a49c-4a5b9ba97147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:25.461644 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3ba6e862-0272-4a53-a49c-4a5b9ba97147 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1520 microversion: 2.1 time: 0.162126 Sep 19 17:31:25.462210 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 400/811] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:25 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:26.486178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0431f7bc-9f38-4335-9804-84f41d4c4be0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:26.486793 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0431f7bc-9f38-4335-9804-84f41d4c4be0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:26.493183 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0431f7bc-9f38-4335-9804-84f41d4c4be0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:26.493672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0431f7bc-9f38-4335-9804-84f41d4c4be0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:26.494112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0431f7bc-9f38-4335-9804-84f41d4c4be0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:26.494808 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0431f7bc-9f38-4335-9804-84f41d4c4be0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:26.495269 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0431f7bc-9f38-4335-9804-84f41d4c4be0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:26.495717 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0431f7bc-9f38-4335-9804-84f41d4c4be0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:26.657364 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0431f7bc-9f38-4335-9804-84f41d4c4be0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:26.665921 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0431f7bc-9f38-4335-9804-84f41d4c4be0 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.184303 Sep 19 17:31:26.666492 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 412/812] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:26 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:27.690436 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f07a9f6c-3476-40d0-a226-2cc8df4e1d5d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:27.691031 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f07a9f6c-3476-40d0-a226-2cc8df4e1d5d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:27.697654 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f07a9f6c-3476-40d0-a226-2cc8df4e1d5d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:27.698143 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f07a9f6c-3476-40d0-a226-2cc8df4e1d5d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:27.698583 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f07a9f6c-3476-40d0-a226-2cc8df4e1d5d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:27.699277 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f07a9f6c-3476-40d0-a226-2cc8df4e1d5d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:27.699751 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f07a9f6c-3476-40d0-a226-2cc8df4e1d5d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:27.700177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f07a9f6c-3476-40d0-a226-2cc8df4e1d5d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:27.833558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f07a9f6c-3476-40d0-a226-2cc8df4e1d5d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:27.841954 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f07a9f6c-3476-40d0-a226-2cc8df4e1d5d tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.156055 Sep 19 17:31:27.842563 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 401/813] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:27 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:28.866268 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f4ed7e21-0a0c-4408-8308-4e89fb7966e1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:28.866877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f4ed7e21-0a0c-4408-8308-4e89fb7966e1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:28.873360 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e21-0a0c-4408-8308-4e89fb7966e1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:28.873846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e21-0a0c-4408-8308-4e89fb7966e1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:28.874307 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e21-0a0c-4408-8308-4e89fb7966e1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:28.874992 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e21-0a0c-4408-8308-4e89fb7966e1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:28.875447 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e21-0a0c-4408-8308-4e89fb7966e1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:28.875901 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e21-0a0c-4408-8308-4e89fb7966e1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:28.879064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:29.236396 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f4ed7e21-0a0c-4408-8308-4e89fb7966e1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:29.244266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f4ed7e21-0a0c-4408-8308-4e89fb7966e1 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.381821 Sep 19 17:31:29.244846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 413/814] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:28 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:30.266793 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6d5e0786-b645-4bd2-8ab8-57593a0b72fb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:30.268056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6d5e0786-b645-4bd2-8ab8-57593a0b72fb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:30.273931 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d5e0786-b645-4bd2-8ab8-57593a0b72fb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:30.274422 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d5e0786-b645-4bd2-8ab8-57593a0b72fb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:30.274865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d5e0786-b645-4bd2-8ab8-57593a0b72fb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:30.275563 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d5e0786-b645-4bd2-8ab8-57593a0b72fb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:30.276057 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d5e0786-b645-4bd2-8ab8-57593a0b72fb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:30.276491 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d5e0786-b645-4bd2-8ab8-57593a0b72fb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:30.407122 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6d5e0786-b645-4bd2-8ab8-57593a0b72fb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:30.415471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6d5e0786-b645-4bd2-8ab8-57593a0b72fb tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.152882 Sep 19 17:31:30.416084 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 402/815] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:30 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:31:31.438564 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e99907e5-8fe5-42a9-94d5-e7c8a9da65b8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:31.439100 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e99907e5-8fe5-42a9-94d5-e7c8a9da65b8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:31.445644 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e99907e5-8fe5-42a9-94d5-e7c8a9da65b8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:31.446123 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e99907e5-8fe5-42a9-94d5-e7c8a9da65b8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:31.446554 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e99907e5-8fe5-42a9-94d5-e7c8a9da65b8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:31.447240 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e99907e5-8fe5-42a9-94d5-e7c8a9da65b8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:31.447686 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e99907e5-8fe5-42a9-94d5-e7c8a9da65b8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:31.448597 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e99907e5-8fe5-42a9-94d5-e7c8a9da65b8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:31.582953 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e99907e5-8fe5-42a9-94d5-e7c8a9da65b8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:31.591130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e99907e5-8fe5-42a9-94d5-e7c8a9da65b8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.156565 Sep 19 17:31:31.591722 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 414/816] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:31 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:32.615071 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c8ab991-368f-45c1-9bae-d5bde63a4a6b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:32.615779 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5c8ab991-368f-45c1-9bae-d5bde63a4a6b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:32.622299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c8ab991-368f-45c1-9bae-d5bde63a4a6b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:32.622833 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c8ab991-368f-45c1-9bae-d5bde63a4a6b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:32.623274 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c8ab991-368f-45c1-9bae-d5bde63a4a6b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:32.624002 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c8ab991-368f-45c1-9bae-d5bde63a4a6b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:32.624464 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c8ab991-368f-45c1-9bae-d5bde63a4a6b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:32.624894 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c8ab991-368f-45c1-9bae-d5bde63a4a6b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:32.754785 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5c8ab991-368f-45c1-9bae-d5bde63a4a6b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:32.762524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c8ab991-368f-45c1-9bae-d5bde63a4a6b tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.151366 Sep 19 17:31:32.763096 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 403/817] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:32 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:33.787004 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-235ec720-ceba-43c8-b001-d92175021e07 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:33.787608 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-235ec720-ceba-43c8-b001-d92175021e07 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:33.794070 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-235ec720-ceba-43c8-b001-d92175021e07 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:33.794542 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-235ec720-ceba-43c8-b001-d92175021e07 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:33.801311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-235ec720-ceba-43c8-b001-d92175021e07 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:33.801311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-235ec720-ceba-43c8-b001-d92175021e07 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:33.801311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-235ec720-ceba-43c8-b001-d92175021e07 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:33.801311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-235ec720-ceba-43c8-b001-d92175021e07 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:33.931424 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-235ec720-ceba-43c8-b001-d92175021e07 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:33.939056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-235ec720-ceba-43c8-b001-d92175021e07 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.156430 Sep 19 17:31:33.939621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 415/818] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:33 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:34.962113 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6fd9f79d-1145-4b0a-9f76-2e695b792f93 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:34.962752 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6fd9f79d-1145-4b0a-9f76-2e695b792f93 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:34.969253 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd9f79d-1145-4b0a-9f76-2e695b792f93 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:34.969738 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd9f79d-1145-4b0a-9f76-2e695b792f93 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:34.970177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd9f79d-1145-4b0a-9f76-2e695b792f93 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:34.970871 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd9f79d-1145-4b0a-9f76-2e695b792f93 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:34.971356 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd9f79d-1145-4b0a-9f76-2e695b792f93 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:34.971804 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd9f79d-1145-4b0a-9f76-2e695b792f93 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:35.103596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6fd9f79d-1145-4b0a-9f76-2e695b792f93 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:35.111458 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6fd9f79d-1145-4b0a-9f76-2e695b792f93 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.153251 Sep 19 17:31:35.112055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 404/819] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:34 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:36.134443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8d0454ff-24c1-44a3-93f5-30db6423bd5c tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:36.135126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8d0454ff-24c1-44a3-93f5-30db6423bd5c tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:36.141971 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d0454ff-24c1-44a3-93f5-30db6423bd5c tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:36.142459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d0454ff-24c1-44a3-93f5-30db6423bd5c tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:36.142902 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d0454ff-24c1-44a3-93f5-30db6423bd5c tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:36.143604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d0454ff-24c1-44a3-93f5-30db6423bd5c tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:36.144089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d0454ff-24c1-44a3-93f5-30db6423bd5c tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:36.144524 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d0454ff-24c1-44a3-93f5-30db6423bd5c tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:36.283072 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8d0454ff-24c1-44a3-93f5-30db6423bd5c tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:36.291839 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8d0454ff-24c1-44a3-93f5-30db6423bd5c tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.161145 Sep 19 17:31:36.292436 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 416/820] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:36 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:37.314318 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-887e6afc-7f8d-45e4-9839-fa05f23045f6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:37.314948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-887e6afc-7f8d-45e4-9839-fa05f23045f6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:37.322036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-887e6afc-7f8d-45e4-9839-fa05f23045f6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:37.322511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-887e6afc-7f8d-45e4-9839-fa05f23045f6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:37.322941 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-887e6afc-7f8d-45e4-9839-fa05f23045f6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:37.323623 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-887e6afc-7f8d-45e4-9839-fa05f23045f6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:37.324104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-887e6afc-7f8d-45e4-9839-fa05f23045f6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:37.324519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-887e6afc-7f8d-45e4-9839-fa05f23045f6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:37.456024 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-887e6afc-7f8d-45e4-9839-fa05f23045f6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:37.465605 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-887e6afc-7f8d-45e4-9839-fa05f23045f6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.155158 Sep 19 17:31:37.466178 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 405/821] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:37 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:37.787347 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7cbe417c-c273-49ba-b903-f041a087f515 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:31:37.789679 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7cbe417c-c273-49ba-b903-f041a087f515 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:37.796081 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cbe417c-c273-49ba-b903-f041a087f515 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:37.796573 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cbe417c-c273-49ba-b903-f041a087f515 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:37.797015 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cbe417c-c273-49ba-b903-f041a087f515 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:37.797716 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cbe417c-c273-49ba-b903-f041a087f515 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:37.798177 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cbe417c-c273-49ba-b903-f041a087f515 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:37.798605 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cbe417c-c273-49ba-b903-f041a087f515 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:38.018190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7cbe417c-c273-49ba-b903-f041a087f515 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "POST /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/action" status: 202 len: 0 microversion: 2.1 time: 0.235220 Sep 19 17:31:38.018857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 417/822] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:31:37 2022] POST /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:31:38.027486 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5297bc4-2195-4223-9028-e5b3a9bbe039 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:38.028130 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5297bc4-2195-4223-9028-e5b3a9bbe039 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:38.034329 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5297bc4-2195-4223-9028-e5b3a9bbe039 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:38.039898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5297bc4-2195-4223-9028-e5b3a9bbe039 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:38.039898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5297bc4-2195-4223-9028-e5b3a9bbe039 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:38.039898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5297bc4-2195-4223-9028-e5b3a9bbe039 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:38.039898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5297bc4-2195-4223-9028-e5b3a9bbe039 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:38.040348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5297bc4-2195-4223-9028-e5b3a9bbe039 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:38.041292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:38.183741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5297bc4-2195-4223-9028-e5b3a9bbe039 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:38.192783 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5297bc4-2195-4223-9028-e5b3a9bbe039 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1752 microversion: 2.1 time: 0.168694 Sep 19 17:31:38.193645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 406/823] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:38 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:38.490853 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0362ad1c-4e18-405e-a7b4-c8dbabbacfaf tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:38.491637 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0362ad1c-4e18-405e-a7b4-c8dbabbacfaf tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:38.498501 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0362ad1c-4e18-405e-a7b4-c8dbabbacfaf tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:38.498988 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0362ad1c-4e18-405e-a7b4-c8dbabbacfaf tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:38.499427 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0362ad1c-4e18-405e-a7b4-c8dbabbacfaf tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:38.500153 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0362ad1c-4e18-405e-a7b4-c8dbabbacfaf tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:38.500601 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0362ad1c-4e18-405e-a7b4-c8dbabbacfaf tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:38.501026 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0362ad1c-4e18-405e-a7b4-c8dbabbacfaf tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:38.603014 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-fe101cd6-6d29-4ba6-b326-4bf4a0b320ad req-4f887323-6322-445c-ba7f-4830d0281ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9442149d-db6c-4fd9-b92a-3eaf3e8c2046", "name": "network-vif-plugged", "status": "completed", "tag": "ddae7d4a-71c6-4777-a374-39594620566f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:31:38.620801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fe101cd6-6d29-4ba6-b326-4bf4a0b320ad req-4f887323-6322-445c-ba7f-4830d0281ef5 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:38.620801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fe101cd6-6d29-4ba6-b326-4bf4a0b320ad req-4f887323-6322-445c-ba7f-4830d0281ef5 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:38.620801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fe101cd6-6d29-4ba6-b326-4bf4a0b320ad req-4f887323-6322-445c-ba7f-4830d0281ef5 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:38.628584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-fe101cd6-6d29-4ba6-b326-4bf4a0b320ad req-4f887323-6322-445c-ba7f-4830d0281ef5 service nova] Creating event network-vif-plugged:ddae7d4a-71c6-4777-a374-39594620566f for instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 on hv-cinder-84801 Sep 19 17:31:38.633849 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-fe101cd6-6d29-4ba6-b326-4bf4a0b320ad req-4f887323-6322-445c-ba7f-4830d0281ef5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035470 Sep 19 17:31:38.634654 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 407/824] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:31:38.644979 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0362ad1c-4e18-405e-a7b4-c8dbabbacfaf tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:38.653299 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0362ad1c-4e18-405e-a7b4-c8dbabbacfaf tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.168118 Sep 19 17:31:38.653860 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 418/825] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:38 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:39.217868 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-91639452-2e38-484d-bc6a-e48dfddbd577 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:39.218558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-91639452-2e38-484d-bc6a-e48dfddbd577 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:39.225032 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91639452-2e38-484d-bc6a-e48dfddbd577 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:39.225529 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91639452-2e38-484d-bc6a-e48dfddbd577 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:39.226026 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91639452-2e38-484d-bc6a-e48dfddbd577 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:39.226737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91639452-2e38-484d-bc6a-e48dfddbd577 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:39.227194 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91639452-2e38-484d-bc6a-e48dfddbd577 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:39.227622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91639452-2e38-484d-bc6a-e48dfddbd577 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:39.369225 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-91639452-2e38-484d-bc6a-e48dfddbd577 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:39.377871 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-91639452-2e38-484d-bc6a-e48dfddbd577 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1757 microversion: 2.1 time: 0.164220 Sep 19 17:31:39.378447 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 408/826] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:39 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:39.677654 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-089b244f-bfe2-4e75-b5aa-2e4ad1734fbd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:39.678200 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-089b244f-bfe2-4e75-b5aa-2e4ad1734fbd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:39.680618 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:39.685350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-089b244f-bfe2-4e75-b5aa-2e4ad1734fbd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:39.685838 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-089b244f-bfe2-4e75-b5aa-2e4ad1734fbd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:39.686283 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-089b244f-bfe2-4e75-b5aa-2e4ad1734fbd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:39.686977 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-089b244f-bfe2-4e75-b5aa-2e4ad1734fbd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:39.687436 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-089b244f-bfe2-4e75-b5aa-2e4ad1734fbd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:39.687900 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-089b244f-bfe2-4e75-b5aa-2e4ad1734fbd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:39.822580 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-089b244f-bfe2-4e75-b5aa-2e4ad1734fbd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:39.830281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-089b244f-bfe2-4e75-b5aa-2e4ad1734fbd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.157239 Sep 19 17:31:39.830856 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 419/827] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:39 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:40.402110 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5ca63e8-c436-4ce5-a25b-601d89300d4d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:40.402715 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5ca63e8-c436-4ce5-a25b-601d89300d4d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:40.409146 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ca63e8-c436-4ce5-a25b-601d89300d4d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:40.409630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ca63e8-c436-4ce5-a25b-601d89300d4d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:40.410066 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ca63e8-c436-4ce5-a25b-601d89300d4d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:40.410758 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ca63e8-c436-4ce5-a25b-601d89300d4d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:40.411213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ca63e8-c436-4ce5-a25b-601d89300d4d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:40.411647 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ca63e8-c436-4ce5-a25b-601d89300d4d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:40.557127 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5ca63e8-c436-4ce5-a25b-601d89300d4d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:40.565609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5ca63e8-c436-4ce5-a25b-601d89300d4d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1757 microversion: 2.1 time: 0.167372 Sep 19 17:31:40.566398 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 409/828] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:40 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:40.852790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8f241578-0062-42bf-ba7a-ea0334f6d465 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:40.853400 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8f241578-0062-42bf-ba7a-ea0334f6d465 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:40.859813 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f241578-0062-42bf-ba7a-ea0334f6d465 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:40.860295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f241578-0062-42bf-ba7a-ea0334f6d465 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:40.860726 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f241578-0062-42bf-ba7a-ea0334f6d465 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:40.861415 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f241578-0062-42bf-ba7a-ea0334f6d465 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:40.861866 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f241578-0062-42bf-ba7a-ea0334f6d465 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:40.862296 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f241578-0062-42bf-ba7a-ea0334f6d465 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:40.994008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8f241578-0062-42bf-ba7a-ea0334f6d465 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:41.001805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8f241578-0062-42bf-ba7a-ea0334f6d465 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1576 microversion: 2.1 time: 0.153524 Sep 19 17:31:41.002391 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 420/829] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:40 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:41.589685 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-df490d63-94a6-4859-9f56-a3bd5a66d5f3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:41.590295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-df490d63-94a6-4859-9f56-a3bd5a66d5f3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:41.596623 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df490d63-94a6-4859-9f56-a3bd5a66d5f3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:41.597098 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df490d63-94a6-4859-9f56-a3bd5a66d5f3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:41.597533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df490d63-94a6-4859-9f56-a3bd5a66d5f3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:41.598215 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df490d63-94a6-4859-9f56-a3bd5a66d5f3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:41.599337 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df490d63-94a6-4859-9f56-a3bd5a66d5f3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:41.599803 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df490d63-94a6-4859-9f56-a3bd5a66d5f3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:41.742906 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-df490d63-94a6-4859-9f56-a3bd5a66d5f3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:41.751287 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-df490d63-94a6-4859-9f56-a3bd5a66d5f3 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1757 microversion: 2.1 time: 0.165434 Sep 19 17:31:41.751890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 410/830] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:41 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:31:42.026557 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1fd3e2ed-a8ee-4d68-8a8e-da12f042cb76 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:42.027134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1fd3e2ed-a8ee-4d68-8a8e-da12f042cb76 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:42.033898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd3e2ed-a8ee-4d68-8a8e-da12f042cb76 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:42.034456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd3e2ed-a8ee-4d68-8a8e-da12f042cb76 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:42.034901 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd3e2ed-a8ee-4d68-8a8e-da12f042cb76 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:42.035608 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd3e2ed-a8ee-4d68-8a8e-da12f042cb76 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:42.036096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd3e2ed-a8ee-4d68-8a8e-da12f042cb76 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:42.036528 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd3e2ed-a8ee-4d68-8a8e-da12f042cb76 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:42.168333 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1fd3e2ed-a8ee-4d68-8a8e-da12f042cb76 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:42.176021 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1fd3e2ed-a8ee-4d68-8a8e-da12f042cb76 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1563 microversion: 2.1 time: 0.153416 Sep 19 17:31:42.176667 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 421/831] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:42 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:42.774698 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5bf5e91-dc4f-422e-a3f4-22a8152e3c3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:42.775254 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5bf5e91-dc4f-422e-a3f4-22a8152e3c3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:42.781727 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5bf5e91-dc4f-422e-a3f4-22a8152e3c3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:42.782216 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5bf5e91-dc4f-422e-a3f4-22a8152e3c3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:42.782671 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5bf5e91-dc4f-422e-a3f4-22a8152e3c3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:42.783367 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5bf5e91-dc4f-422e-a3f4-22a8152e3c3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:42.783853 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5bf5e91-dc4f-422e-a3f4-22a8152e3c3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:42.784287 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5bf5e91-dc4f-422e-a3f4-22a8152e3c3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:42.931000 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5bf5e91-dc4f-422e-a3f4-22a8152e3c3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:42.939253 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5bf5e91-dc4f-422e-a3f4-22a8152e3c3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1757 microversion: 2.1 time: 0.168523 Sep 19 17:31:42.939851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 411/832] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:42 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:43.962226 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b885adc0-095a-44fb-89c6-eef818360b6d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:43.962849 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b885adc0-095a-44fb-89c6-eef818360b6d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:43.969620 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b885adc0-095a-44fb-89c6-eef818360b6d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:43.970104 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b885adc0-095a-44fb-89c6-eef818360b6d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:43.970539 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b885adc0-095a-44fb-89c6-eef818360b6d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:43.971235 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b885adc0-095a-44fb-89c6-eef818360b6d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:43.971704 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b885adc0-095a-44fb-89c6-eef818360b6d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:43.972144 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b885adc0-095a-44fb-89c6-eef818360b6d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:44.117227 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b885adc0-095a-44fb-89c6-eef818360b6d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:44.125396 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b885adc0-095a-44fb-89c6-eef818360b6d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1757 microversion: 2.1 time: 0.167092 Sep 19 17:31:44.125980 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 422/833] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:43 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:45.150774 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ed98e69-e333-44ca-83ac-dafb6b70d0de tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:45.151400 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0ed98e69-e333-44ca-83ac-dafb6b70d0de tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:45.157568 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed98e69-e333-44ca-83ac-dafb6b70d0de tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:45.158051 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed98e69-e333-44ca-83ac-dafb6b70d0de tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:45.158492 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed98e69-e333-44ca-83ac-dafb6b70d0de tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:45.159194 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed98e69-e333-44ca-83ac-dafb6b70d0de tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:45.159652 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed98e69-e333-44ca-83ac-dafb6b70d0de tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:45.160215 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ed98e69-e333-44ca-83ac-dafb6b70d0de tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:45.313001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ed98e69-e333-44ca-83ac-dafb6b70d0de tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:45.321945 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0ed98e69-e333-44ca-83ac-dafb6b70d0de tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1757 microversion: 2.1 time: 0.176490 Sep 19 17:31:45.322531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 412/834] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:45 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:46.345171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6abb4c6b-9b32-4fff-8a63-3f0784134ae6 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:46.345959 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6abb4c6b-9b32-4fff-8a63-3f0784134ae6 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:46.352465 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6abb4c6b-9b32-4fff-8a63-3f0784134ae6 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:46.352950 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6abb4c6b-9b32-4fff-8a63-3f0784134ae6 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:46.353395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6abb4c6b-9b32-4fff-8a63-3f0784134ae6 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:46.354096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6abb4c6b-9b32-4fff-8a63-3f0784134ae6 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:46.354556 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6abb4c6b-9b32-4fff-8a63-3f0784134ae6 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:46.354994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6abb4c6b-9b32-4fff-8a63-3f0784134ae6 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:46.499931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6abb4c6b-9b32-4fff-8a63-3f0784134ae6 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:46.508186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6abb4c6b-9b32-4fff-8a63-3f0784134ae6 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1757 microversion: 2.1 time: 0.167037 Sep 19 17:31:46.508760 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 423/835] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:46 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:47.531614 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62f28b38-be50-40d4-b547-19cf34c5eb6b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:47.532323 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62f28b38-be50-40d4-b547-19cf34c5eb6b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:47.539461 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f28b38-be50-40d4-b547-19cf34c5eb6b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:47.539976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f28b38-be50-40d4-b547-19cf34c5eb6b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:47.541019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f28b38-be50-40d4-b547-19cf34c5eb6b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:47.541709 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f28b38-be50-40d4-b547-19cf34c5eb6b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:47.542173 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f28b38-be50-40d4-b547-19cf34c5eb6b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:47.542595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f28b38-be50-40d4-b547-19cf34c5eb6b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:47.682700 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-62f28b38-be50-40d4-b547-19cf34c5eb6b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:47.691095 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62f28b38-be50-40d4-b547-19cf34c5eb6b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1757 microversion: 2.1 time: 0.163357 Sep 19 17:31:47.691725 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 413/836] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:47 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:48.714720 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0b59b338-7a6f-4f51-b304-6c7e836f90ea tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:48.715325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0b59b338-7a6f-4f51-b304-6c7e836f90ea tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:48.721838 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b59b338-7a6f-4f51-b304-6c7e836f90ea tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:48.722314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b59b338-7a6f-4f51-b304-6c7e836f90ea tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:48.722754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b59b338-7a6f-4f51-b304-6c7e836f90ea tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:48.723963 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b59b338-7a6f-4f51-b304-6c7e836f90ea tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:48.724420 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b59b338-7a6f-4f51-b304-6c7e836f90ea tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:48.724848 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b59b338-7a6f-4f51-b304-6c7e836f90ea tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:48.871442 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0b59b338-7a6f-4f51-b304-6c7e836f90ea tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:48.879649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0b59b338-7a6f-4f51-b304-6c7e836f90ea tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1757 microversion: 2.1 time: 0.168832 Sep 19 17:31:48.880250 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 424/837] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:48 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:49.903065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0798b066-2bd3-47a5-9df4-55c512eda439 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:49.903714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0798b066-2bd3-47a5-9df4-55c512eda439 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:49.905662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=38 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:49.910375 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0798b066-2bd3-47a5-9df4-55c512eda439 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:49.911018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0798b066-2bd3-47a5-9df4-55c512eda439 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:49.911460 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0798b066-2bd3-47a5-9df4-55c512eda439 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:49.912184 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0798b066-2bd3-47a5-9df4-55c512eda439 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:49.912638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0798b066-2bd3-47a5-9df4-55c512eda439 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:49.921463 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0798b066-2bd3-47a5-9df4-55c512eda439 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:50.059374 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0798b066-2bd3-47a5-9df4-55c512eda439 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:50.068280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0798b066-2bd3-47a5-9df4-55c512eda439 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1757 microversion: 2.1 time: 0.169341 Sep 19 17:31:50.068856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 414/838] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:49 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:51.090516 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f03efde-f365-43ce-b4c6-415a14b5556e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:51.091159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4f03efde-f365-43ce-b4c6-415a14b5556e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:51.098327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f03efde-f365-43ce-b4c6-415a14b5556e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:51.098820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f03efde-f365-43ce-b4c6-415a14b5556e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:51.099259 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f03efde-f365-43ce-b4c6-415a14b5556e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:51.100154 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f03efde-f365-43ce-b4c6-415a14b5556e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:51.100700 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f03efde-f365-43ce-b4c6-415a14b5556e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:51.101215 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f03efde-f365-43ce-b4c6-415a14b5556e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:51.254126 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e53558b9-7937-4d4c-a8f0-a1e10012cdcb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:51.256102 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e53558b9-7937-4d4c-a8f0-a1e10012cdcb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:51.263988 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e53558b9-7937-4d4c-a8f0-a1e10012cdcb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:51.267596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f03efde-f365-43ce-b4c6-415a14b5556e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:51.272183 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e53558b9-7937-4d4c-a8f0-a1e10012cdcb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:51.275471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e53558b9-7937-4d4c-a8f0-a1e10012cdcb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:51.276287 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e53558b9-7937-4d4c-a8f0-a1e10012cdcb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:51.276887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e53558b9-7937-4d4c-a8f0-a1e10012cdcb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:51.277325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e53558b9-7937-4d4c-a8f0-a1e10012cdcb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:51.279341 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f03efde-f365-43ce-b4c6-415a14b5556e tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1757 microversion: 2.1 time: 0.192599 Sep 19 17:31:51.283736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 425/839] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:51 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:51.373891 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e53558b9-7937-4d4c-a8f0-a1e10012cdcb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lazy-loading 'services' on Instance uuid f2632c0f-04a3-4b90-b4b1-f8989649a34a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:31:51.619189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e53558b9-7937-4d4c-a8f0-a1e10012cdcb tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments/f43c7503-0ec7-4634-ab0f-a88ffc7da24f" status: 202 len: 0 microversion: 2.1 time: 0.371788 Sep 19 17:31:51.628591 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 415/840] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:31:51 2022] DELETE /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments/f43c7503-0ec7-4634-ab0f-a88ffc7da24f => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:31:51.628791 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73fed0f2-9370-4460-8453-718dbc9ffffe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:51.631309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-73fed0f2-9370-4460-8453-718dbc9ffffe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:51.636899 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73fed0f2-9370-4460-8453-718dbc9ffffe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:51.637387 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73fed0f2-9370-4460-8453-718dbc9ffffe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:51.637829 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73fed0f2-9370-4460-8453-718dbc9ffffe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:51.638533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73fed0f2-9370-4460-8453-718dbc9ffffe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:51.638990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73fed0f2-9370-4460-8453-718dbc9ffffe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:51.639418 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73fed0f2-9370-4460-8453-718dbc9ffffe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:51.669989 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73fed0f2-9370-4460-8453-718dbc9ffffe tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045677 Sep 19 17:31:51.670545 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 426/841] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:31:51 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:31:52.304598 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98def220-066e-4795-af3a-e632500ef274 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:52.305426 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98def220-066e-4795-af3a-e632500ef274 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:52.311802 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98def220-066e-4795-af3a-e632500ef274 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:52.312304 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98def220-066e-4795-af3a-e632500ef274 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:52.312784 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98def220-066e-4795-af3a-e632500ef274 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:52.313453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98def220-066e-4795-af3a-e632500ef274 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:52.313918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98def220-066e-4795-af3a-e632500ef274 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:52.314349 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98def220-066e-4795-af3a-e632500ef274 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:52.457530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-98def220-066e-4795-af3a-e632500ef274 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:52.465893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98def220-066e-4795-af3a-e632500ef274 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1760 microversion: 2.1 time: 0.166677 Sep 19 17:31:52.466477 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 416/842] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:52 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:52.683074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a468c8ce-4bbe-4385-8450-35564c635ae6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:52.685321 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a468c8ce-4bbe-4385-8450-35564c635ae6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:52.691865 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a468c8ce-4bbe-4385-8450-35564c635ae6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:52.692352 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a468c8ce-4bbe-4385-8450-35564c635ae6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:52.692792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a468c8ce-4bbe-4385-8450-35564c635ae6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:52.693484 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a468c8ce-4bbe-4385-8450-35564c635ae6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:52.693942 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a468c8ce-4bbe-4385-8450-35564c635ae6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:52.694370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a468c8ce-4bbe-4385-8450-35564c635ae6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:52.723744 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a468c8ce-4bbe-4385-8450-35564c635ae6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043976 Sep 19 17:31:52.724222 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 427/843] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:31:52 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:31:53.736081 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-25538693-10af-48ff-b4a2-e2bed1283bef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:53.738323 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-25538693-10af-48ff-b4a2-e2bed1283bef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:53.745361 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25538693-10af-48ff-b4a2-e2bed1283bef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:53.745848 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25538693-10af-48ff-b4a2-e2bed1283bef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:53.746288 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25538693-10af-48ff-b4a2-e2bed1283bef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:53.746986 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25538693-10af-48ff-b4a2-e2bed1283bef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:53.747446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25538693-10af-48ff-b4a2-e2bed1283bef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:53.747982 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25538693-10af-48ff-b4a2-e2bed1283bef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:53.777823 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-25538693-10af-48ff-b4a2-e2bed1283bef tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045966 Sep 19 17:31:53.778385 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 417/844] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:31:53 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 17:31:53.857961 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c02a51e1-5a6a-41d8-96e1-33298e0937b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:53.862982 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c02a51e1-5a6a-41d8-96e1-33298e0937b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:53.865505 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02a51e1-5a6a-41d8-96e1-33298e0937b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:53.865988 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02a51e1-5a6a-41d8-96e1-33298e0937b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:53.866422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02a51e1-5a6a-41d8-96e1-33298e0937b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:53.867115 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02a51e1-5a6a-41d8-96e1-33298e0937b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:53.867563 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02a51e1-5a6a-41d8-96e1-33298e0937b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:53.868022 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02a51e1-5a6a-41d8-96e1-33298e0937b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:53.893554 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c02a51e1-5a6a-41d8-96e1-33298e0937b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:31:53.896331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:31:54.247945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c02a51e1-5a6a-41d8-96e1-33298e0937b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 204 len: 0 microversion: 2.1 time: 0.393525 Sep 19 17:31:54.248550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 428/845] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:31:53 2022] DELETE /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:31:54.256686 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aabb3f4b-4120-4b79-9230-08997775a2e9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:54.257299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aabb3f4b-4120-4b79-9230-08997775a2e9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:54.263576 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aabb3f4b-4120-4b79-9230-08997775a2e9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:54.264121 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aabb3f4b-4120-4b79-9230-08997775a2e9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:54.264567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aabb3f4b-4120-4b79-9230-08997775a2e9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:54.265618 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aabb3f4b-4120-4b79-9230-08997775a2e9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:54.266077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aabb3f4b-4120-4b79-9230-08997775a2e9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:54.266506 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aabb3f4b-4120-4b79-9230-08997775a2e9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:54.399738 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-aabb3f4b-4120-4b79-9230-08997775a2e9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:54.407414 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aabb3f4b-4120-4b79-9230-08997775a2e9 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1691 microversion: 2.1 time: 0.154558 Sep 19 17:31:54.408018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 418/846] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:54 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:55.431819 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f0f41fe6-2d4a-45d2-bb38-1ea2ca3d40e5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:55.432525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f0f41fe6-2d4a-45d2-bb38-1ea2ca3d40e5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:55.438913 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0f41fe6-2d4a-45d2-bb38-1ea2ca3d40e5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:55.439400 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0f41fe6-2d4a-45d2-bb38-1ea2ca3d40e5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:55.439875 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0f41fe6-2d4a-45d2-bb38-1ea2ca3d40e5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:55.440570 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0f41fe6-2d4a-45d2-bb38-1ea2ca3d40e5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:55.441027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0f41fe6-2d4a-45d2-bb38-1ea2ca3d40e5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:55.441460 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0f41fe6-2d4a-45d2-bb38-1ea2ca3d40e5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:55.570259 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0f41fe6-2d4a-45d2-bb38-1ea2ca3d40e5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:55.577962 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f0f41fe6-2d4a-45d2-bb38-1ea2ca3d40e5 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1691 microversion: 2.1 time: 0.150398 Sep 19 17:31:55.578529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 429/847] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:55 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:56.601246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-80dfe5a8-0ec8-4f01-a4c4-d79e4b6bfe87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:56.601853 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-80dfe5a8-0ec8-4f01-a4c4-d79e4b6bfe87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:56.608484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80dfe5a8-0ec8-4f01-a4c4-d79e4b6bfe87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:56.608965 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80dfe5a8-0ec8-4f01-a4c4-d79e4b6bfe87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:56.609401 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80dfe5a8-0ec8-4f01-a4c4-d79e4b6bfe87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:56.610091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80dfe5a8-0ec8-4f01-a4c4-d79e4b6bfe87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:56.610541 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80dfe5a8-0ec8-4f01-a4c4-d79e4b6bfe87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:56.610962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80dfe5a8-0ec8-4f01-a4c4-d79e4b6bfe87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:56.739242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-80dfe5a8-0ec8-4f01-a4c4-d79e4b6bfe87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:56.747103 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-80dfe5a8-0ec8-4f01-a4c4-d79e4b6bfe87 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1691 microversion: 2.1 time: 0.149782 Sep 19 17:31:56.747676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 419/848] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:56 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:57.770701 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a889524f-06ef-4411-a94f-7b056cc1c6f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:57.771307 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a889524f-06ef-4411-a94f-7b056cc1c6f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:57.778249 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a889524f-06ef-4411-a94f-7b056cc1c6f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:57.778729 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a889524f-06ef-4411-a94f-7b056cc1c6f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:57.779163 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a889524f-06ef-4411-a94f-7b056cc1c6f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:57.779876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a889524f-06ef-4411-a94f-7b056cc1c6f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:57.780331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a889524f-06ef-4411-a94f-7b056cc1c6f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:57.780750 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a889524f-06ef-4411-a94f-7b056cc1c6f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:57.914473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a889524f-06ef-4411-a94f-7b056cc1c6f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:57.922732 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a889524f-06ef-4411-a94f-7b056cc1c6f7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1691 microversion: 2.1 time: 0.155939 Sep 19 17:31:57.923311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 430/849] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:57 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:58.945940 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-001d20ab-21f5-4b17-b978-529c7edcd8b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:31:58.946606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-001d20ab-21f5-4b17-b978-529c7edcd8b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:31:58.953200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-001d20ab-21f5-4b17-b978-529c7edcd8b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:58.953694 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-001d20ab-21f5-4b17-b978-529c7edcd8b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:58.954189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-001d20ab-21f5-4b17-b978-529c7edcd8b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:58.954987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-001d20ab-21f5-4b17-b978-529c7edcd8b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:58.955449 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-001d20ab-21f5-4b17-b978-529c7edcd8b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:58.956015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-001d20ab-21f5-4b17-b978-529c7edcd8b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:59.028056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-001d20ab-21f5-4b17-b978-529c7edcd8b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:31:59.038419 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-001d20ab-21f5-4b17-b978-529c7edcd8b6 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1623 microversion: 2.1 time: 0.095656 Sep 19 17:31:59.051653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 420/850] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:31:58 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1623 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:31:59.087767 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e4d11ff9-4735-4c1d-86cb-d3890bb0aa4c req-6520e887-6816-4dca-962c-6677a06d596a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2632c0f-04a3-4b90-b4b1-f8989649a34a", "name": "network-vif-deleted", "tag": "8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:31:59.097842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e4d11ff9-4735-4c1d-86cb-d3890bb0aa4c req-6520e887-6816-4dca-962c-6677a06d596a service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:31:59.098310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e4d11ff9-4735-4c1d-86cb-d3890bb0aa4c req-6520e887-6816-4dca-962c-6677a06d596a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:31:59.098966 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e4d11ff9-4735-4c1d-86cb-d3890bb0aa4c req-6520e887-6816-4dca-962c-6677a06d596a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:31:59.114750 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e4d11ff9-4735-4c1d-86cb-d3890bb0aa4c req-6520e887-6816-4dca-962c-6677a06d596a service nova] Creating event network-vif-deleted:8ac3ba9a-d625-47e1-8d4d-a4c416cd2ca0 for instance f2632c0f-04a3-4b90-b4b1-f8989649a34a on hv-cinder-84801 Sep 19 17:31:59.127124 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e4d11ff9-4735-4c1d-86cb-d3890bb0aa4c req-6520e887-6816-4dca-962c-6677a06d596a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043211 Sep 19 17:31:59.129560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 431/851] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:00.064510 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:00.065907 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:00.073050 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:00.073544 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:00.074064 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:00.074782 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:00.075245 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:00.075938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:00.110736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:00.111226 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:00.111711 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:00.112184 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lazy-loading 'fault' on Instance uuid f2632c0f-04a3-4b90-b4b1-f8989649a34a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:32:00.153916 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:00.161748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a8b35582-fdfa-4a95-a6d7-5b430140cd53 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 200 len: 1335 microversion: 2.1 time: 0.101362 Sep 19 17:32:00.162323 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 421/852] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:00 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 1335 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:01.187387 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:01.188137 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f2632c0f-04a3-4b90-b4b1-f8989649a34a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:01.194564 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:01.195168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:01.195635 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:01.196312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:01.196776 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:01.197242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:01.210651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] HTTP exception thrown: Instance f2632c0f-04a3-4b90-b4b1-f8989649a34a could not be found. Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Request method failure captured: Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a HTTP/1.1 Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKWMWEfop28VzjVJxhEt1SrAA6vyu-Djio5TQQ93Op_5LUruPf_K-j6q9Ueg4oIQCsMrIXevBlXeqOdKnn9vWSqE1F-p6cnVQWlCOcxrCZxCtS7BtyW145HEy0dAywADtm3t4USmgSJLNoWRwvsKSouHGmnzxc_QEXYcwdBWu0ZBG_s Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 4118102ca29c4b0fa344b21b9c9f1e85 Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:32:01.212224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4118102ca29c4b0fa344b21b9c9f1e85"}]}] Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 4118102ca29c4b0fa344b21b9c9f1e85 Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-ServerRescueNegativeTestJSON-847106187-project Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 4f460a4884d1486484a683f440459b6e Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-ServerRescueNegativeTestJSON-847106187-project Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance f2632c0f-04a3-4b90-b4b1-f8989649a34a could not be found. Sep 19 17:32:01.213932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': 'f2632c0f-04a3-4b90-b4b1-f8989649a34a'} Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2632c0f-04a3-4b90-b4b1-f8989649a34a could not be found. Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:32:01.214864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2632c0f-04a3-4b90-b4b1-f8989649a34a could not be found. Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2632c0f-04a3-4b90-b4b1-f8989649a34a could not be found. Sep 19 17:32:01.216478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:32:01.217877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Returning 404 to user: Instance f2632c0f-04a3-4b90-b4b1-f8989649a34a could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:32:01.217877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-acfafd30-9731-448e-a0c0-a7d28a74eabf tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a" status: 404 len: 111 microversion: 2.1 time: 0.030970 Sep 19 17:32:01.217877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 432/853] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:01 2022] GET /compute/v2.1/servers/f2632c0f-04a3-4b90-b4b1-f8989649a34a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:32:01.222685 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54db302e-022e-466a-be05-7de377c19b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '.version_select at 0x7fd4d5e19310>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:01.294568 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54db302e-022e-466a-be05-7de377c19b8b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-647718401" status: 202 len: 0 microversion: 2.1 time: 0.075689 Sep 19 17:32:01.295159 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 422/854] 10.222.0.61 () {58 vars in 1218 bytes} [Mon Sep 19 17:32:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-647718401 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:32:04.518449 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-becfdf9c-bf84-4fbd-be5e-5ce7083bde4b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:04.518943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-becfdf9c-bf84-4fbd-be5e-5ce7083bde4b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:04.525948 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-becfdf9c-bf84-4fbd-be5e-5ce7083bde4b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:04.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-becfdf9c-bf84-4fbd-be5e-5ce7083bde4b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:04.526863 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-becfdf9c-bf84-4fbd-be5e-5ce7083bde4b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:04.527583 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-becfdf9c-bf84-4fbd-be5e-5ce7083bde4b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:04.528067 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-becfdf9c-bf84-4fbd-be5e-5ce7083bde4b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:04.528496 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-becfdf9c-bf84-4fbd-be5e-5ce7083bde4b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:04.554171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-becfdf9c-bf84-4fbd-be5e-5ce7083bde4b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:32:04.806678 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-becfdf9c-bf84-4fbd-be5e-5ce7083bde4b tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 204 len: 0 microversion: 2.1 time: 0.291889 Sep 19 17:32:04.807192 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 433/855] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:32:04 2022] DELETE /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:32:04.816339 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d758024d-45ca-4bdb-9431-fe209a0ce889 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:04.816944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d758024d-45ca-4bdb-9431-fe209a0ce889 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:04.824105 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d758024d-45ca-4bdb-9431-fe209a0ce889 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:04.824618 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d758024d-45ca-4bdb-9431-fe209a0ce889 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:04.825059 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d758024d-45ca-4bdb-9431-fe209a0ce889 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:04.825747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d758024d-45ca-4bdb-9431-fe209a0ce889 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:04.826198 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d758024d-45ca-4bdb-9431-fe209a0ce889 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:04.826624 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d758024d-45ca-4bdb-9431-fe209a0ce889 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:04.841828 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:04.954294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d758024d-45ca-4bdb-9431-fe209a0ce889 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:04.962776 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d758024d-45ca-4bdb-9431-fe209a0ce889 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1507 microversion: 2.1 time: 0.151264 Sep 19 17:32:04.963343 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 423/856] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:04 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:05.990699 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-70031285-cfd6-429c-b0dd-c34c5d7ebdc0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:05.992568 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-70031285-cfd6-429c-b0dd-c34c5d7ebdc0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:06.003589 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70031285-cfd6-429c-b0dd-c34c5d7ebdc0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:06.008931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70031285-cfd6-429c-b0dd-c34c5d7ebdc0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:06.008931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70031285-cfd6-429c-b0dd-c34c5d7ebdc0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:06.008931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70031285-cfd6-429c-b0dd-c34c5d7ebdc0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:06.008931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70031285-cfd6-429c-b0dd-c34c5d7ebdc0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:06.009547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70031285-cfd6-429c-b0dd-c34c5d7ebdc0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:06.161539 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-70031285-cfd6-429c-b0dd-c34c5d7ebdc0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:06.169559 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-70031285-cfd6-429c-b0dd-c34c5d7ebdc0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1507 microversion: 2.1 time: 0.186963 Sep 19 17:32:06.170138 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 434/857] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:05 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:06.362901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2cc68962-0a7c-42f3-b018-614a31d3fc52 req-9c9aa9b3-15ef-4afd-be87-eebd713d596b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f141f191-3cdc-4eef-8f61-bea738735537", "name": "network-vif-deleted", "tag": "e5a3c33b-3371-42fa-9473-41736f479159"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:06.374061 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2cc68962-0a7c-42f3-b018-614a31d3fc52 req-9c9aa9b3-15ef-4afd-be87-eebd713d596b service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:06.374669 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2cc68962-0a7c-42f3-b018-614a31d3fc52 req-9c9aa9b3-15ef-4afd-be87-eebd713d596b service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:06.375147 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2cc68962-0a7c-42f3-b018-614a31d3fc52 req-9c9aa9b3-15ef-4afd-be87-eebd713d596b service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:06.386828 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2cc68962-0a7c-42f3-b018-614a31d3fc52 req-9c9aa9b3-15ef-4afd-be87-eebd713d596b service nova] Creating event network-vif-deleted:e5a3c33b-3371-42fa-9473-41736f479159 for instance f141f191-3cdc-4eef-8f61-bea738735537 on hv-cinder-84801 Sep 19 17:32:06.392454 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2cc68962-0a7c-42f3-b018-614a31d3fc52 req-9c9aa9b3-15ef-4afd-be87-eebd713d596b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037846 Sep 19 17:32:06.393451 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 424/858] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:07.193475 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:07.194018 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:07.200407 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:07.200884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:07.201315 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:07.202039 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:07.202486 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:07.202906 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:07.232785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:07.233253 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:07.233684 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:07.234121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lazy-loading 'fault' on Instance uuid f141f191-3cdc-4eef-8f61-bea738735537 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:32:07.273965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:07.281586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df051a44-e6e8-4c77-a06d-6d2535b24212 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 200 len: 1311 microversion: 2.1 time: 0.092026 Sep 19 17:32:07.285049 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 435/859] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:07 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:08.306309 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:08.307015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: f141f191-3cdc-4eef-8f61-bea738735537] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:08.313838 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:08.314325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:08.314768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:08.315471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:08.315958 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:08.316391 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:08.330349 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] HTTP exception thrown: Instance f141f191-3cdc-4eef-8f61-bea738735537 could not be found. Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Request method failure captured: Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 HTTP/1.1 Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWMWEfop28VzjVJxhEt1SrAA6vyu-Djio5TQQ93Op_5LUruPf_K-j6q9Ueg4oIQCsMrIXevBlXeqOdKnn9vWSqE1F-p6cnVQWlCOcxrCZxCtS7BtyW145HEy0dAywADtm3t4USmgSJLNoWRwvsKSouHGmnzxc_QEXYcwdBWu0ZBG_s Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 4118102ca29c4b0fa344b21b9c9f1e85 Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:32:08.332012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4118102ca29c4b0fa344b21b9c9f1e85"}]}] Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 4118102ca29c4b0fa344b21b9c9f1e85 Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-ServerRescueNegativeTestJSON-847106187-project Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 4f460a4884d1486484a683f440459b6e Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-847106187-project Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance f141f191-3cdc-4eef-8f61-bea738735537 could not be found. Sep 19 17:32:08.333633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': 'f141f191-3cdc-4eef-8f61-bea738735537'} Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f141f191-3cdc-4eef-8f61-bea738735537 could not be found. Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:32:08.334442 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f141f191-3cdc-4eef-8f61-bea738735537 could not be found. Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f141f191-3cdc-4eef-8f61-bea738735537 could not be found. Sep 19 17:32:08.335629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:08.336805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Returning 404 to user: Instance f141f191-3cdc-4eef-8f61-bea738735537 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:32:08.336805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a250f978-290b-438d-818c-2075426ffbcd tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537" status: 404 len: 111 microversion: 2.1 time: 0.031811 Sep 19 17:32:08.336805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 425/860] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:08 2022] GET /compute/v2.1/servers/f141f191-3cdc-4eef-8f61-bea738735537 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:32:08.341995 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-82bcc78a-9197-4116-b895-af3e8cffaa35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:08.342493 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-82bcc78a-9197-4116-b895-af3e8cffaa35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:08.348868 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82bcc78a-9197-4116-b895-af3e8cffaa35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:08.349348 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82bcc78a-9197-4116-b895-af3e8cffaa35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:08.349786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82bcc78a-9197-4116-b895-af3e8cffaa35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:08.350476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82bcc78a-9197-4116-b895-af3e8cffaa35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:08.350932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82bcc78a-9197-4116-b895-af3e8cffaa35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:08.351361 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82bcc78a-9197-4116-b895-af3e8cffaa35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:08.376590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-82bcc78a-9197-4116-b895-af3e8cffaa35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:32:08.613634 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-82bcc78a-9197-4116-b895-af3e8cffaa35 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 204 len: 0 microversion: 2.1 time: 0.275156 Sep 19 17:32:08.614233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 436/861] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:32:08 2022] DELETE /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:32:08.623395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be1367f6-202f-4376-98ec-c97883bee839 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:08.624042 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be1367f6-202f-4376-98ec-c97883bee839 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:08.630894 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1367f6-202f-4376-98ec-c97883bee839 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:08.631376 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1367f6-202f-4376-98ec-c97883bee839 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:08.631838 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1367f6-202f-4376-98ec-c97883bee839 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:08.632702 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1367f6-202f-4376-98ec-c97883bee839 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:08.633159 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1367f6-202f-4376-98ec-c97883bee839 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:08.633582 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1367f6-202f-4376-98ec-c97883bee839 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:08.759799 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-be1367f6-202f-4376-98ec-c97883bee839 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:08.767647 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be1367f6-202f-4376-98ec-c97883bee839 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.148275 Sep 19 17:32:08.768231 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 426/862] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:08 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:09.791386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f4220db-262c-46b6-8320-af9b452fc1c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:09.792157 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4f4220db-262c-46b6-8320-af9b452fc1c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:09.794569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:09.799275 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4220db-262c-46b6-8320-af9b452fc1c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:09.804872 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4220db-262c-46b6-8320-af9b452fc1c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:09.804872 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4220db-262c-46b6-8320-af9b452fc1c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:09.804872 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4220db-262c-46b6-8320-af9b452fc1c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:09.804872 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4220db-262c-46b6-8320-af9b452fc1c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:09.805258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4220db-262c-46b6-8320-af9b452fc1c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:09.937786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f4220db-262c-46b6-8320-af9b452fc1c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:09.946306 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f4220db-262c-46b6-8320-af9b452fc1c0 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1522 microversion: 2.1 time: 0.159425 Sep 19 17:32:09.946884 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 437/863] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:09 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:10.259982 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-8c03bd80-ca5a-4f27-b9a2-e28876ba14a7 req-15df0270-f9ba-4697-af38-a7b70e6564c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c05ebb-0e1d-4420-b50a-c289b41715da", "name": "network-vif-deleted", "tag": "9d69013e-49a8-47b6-be21-f1203cc13ade"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:10.270268 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8c03bd80-ca5a-4f27-b9a2-e28876ba14a7 req-15df0270-f9ba-4697-af38-a7b70e6564c8 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:10.270772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8c03bd80-ca5a-4f27-b9a2-e28876ba14a7 req-15df0270-f9ba-4697-af38-a7b70e6564c8 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:10.271203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8c03bd80-ca5a-4f27-b9a2-e28876ba14a7 req-15df0270-f9ba-4697-af38-a7b70e6564c8 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:10.281944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-8c03bd80-ca5a-4f27-b9a2-e28876ba14a7 req-15df0270-f9ba-4697-af38-a7b70e6564c8 service nova] Creating event network-vif-deleted:9d69013e-49a8-47b6-be21-f1203cc13ade for instance 16c05ebb-0e1d-4420-b50a-c289b41715da on hv-cinder-84801 Sep 19 17:32:10.287006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-8c03bd80-ca5a-4f27-b9a2-e28876ba14a7 req-15df0270-f9ba-4697-af38-a7b70e6564c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030739 Sep 19 17:32:10.287566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 427/864] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:10.969500 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:10.973190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:10.976701 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:10.977188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:10.977632 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:10.978324 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:10.978779 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:10.979204 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:11.009882 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:11.010371 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:11.010904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:11.011354 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lazy-loading 'fault' on Instance uuid 16c05ebb-0e1d-4420-b50a-c289b41715da {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:32:11.050447 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f460a4884d1486484a683f440459b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4118102ca29c4b0fa344b21b9c9f1e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:11.058073 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc40c013-c5a4-46eb-93eb-0d53ef01af7e tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 200 len: 1312 microversion: 2.1 time: 0.092453 Sep 19 17:32:11.058641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 438/865] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:10 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:12.082391 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:12.083089 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] [instance: 16c05ebb-0e1d-4420-b50a-c289b41715da] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:12.089921 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:12.090405 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:12.090976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:12.091668 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:12.092149 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:12.092578 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:12.106315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] HTTP exception thrown: Instance 16c05ebb-0e1d-4420-b50a-c289b41715da could not be found. Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Request method failure captured: Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da HTTP/1.1 Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWMWEfop28VzjVJxhEt1SrAA6vyu-Djio5TQQ93Op_5LUruPf_K-j6q9Ueg4oIQCsMrIXevBlXeqOdKnn9vWSqE1F-p6cnVQWlCOcxrCZxCtS7BtyW145HEy0dAywADtm3t4USmgSJLNoWRwvsKSouHGmnzxc_QEXYcwdBWu0ZBG_s Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 4118102ca29c4b0fa344b21b9c9f1e85 Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:32:12.107981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4118102ca29c4b0fa344b21b9c9f1e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4118102ca29c4b0fa344b21b9c9f1e85"}]}] Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 4118102ca29c4b0fa344b21b9c9f1e85 Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-847106187 Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-ServerRescueNegativeTestJSON-847106187-project Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 4f460a4884d1486484a683f440459b6e Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-847106187-project Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 16c05ebb-0e1d-4420-b50a-c289b41715da could not be found. Sep 19 17:32:12.109466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '16c05ebb-0e1d-4420-b50a-c289b41715da'} Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16c05ebb-0e1d-4420-b50a-c289b41715da could not be found. Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:32:12.110233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16c05ebb-0e1d-4420-b50a-c289b41715da could not be found. Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16c05ebb-0e1d-4420-b50a-c289b41715da could not be found. Sep 19 17:32:12.111638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:12.112970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] Returning 404 to user: Instance 16c05ebb-0e1d-4420-b50a-c289b41715da could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:32:12.112970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6bcba44c-8148-4878-a16d-493d4365a1d7 tempest-ServerRescueNegativeTestJSON-847106187 tempest-ServerRescueNegativeTestJSON-847106187-project] 10.222.0.61 "GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da" status: 404 len: 111 microversion: 2.1 time: 0.031693 Sep 19 17:32:12.112970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 428/866] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:12 2022] GET /compute/v2.1/servers/16c05ebb-0e1d-4420-b50a-c289b41715da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:32:21.060826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f7233a8-c5d4-462a-9559-995c14c75ca2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:21.063099 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f7233a8-c5d4-462a-9559-995c14c75ca2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:21.066295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=5 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:21.067176 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:21.071951 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f7233a8-c5d4-462a-9559-995c14c75ca2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:21.072451 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f7233a8-c5d4-462a-9559-995c14c75ca2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:21.073245 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f7233a8-c5d4-462a-9559-995c14c75ca2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:21.074138 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f7233a8-c5d4-462a-9559-995c14c75ca2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:21.074603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f7233a8-c5d4-462a-9559-995c14c75ca2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:21.075034 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f7233a8-c5d4-462a-9559-995c14c75ca2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:21.107067 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f7233a8-c5d4-462a-9559-995c14c75ca2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050428 Sep 19 17:32:21.107800 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 439/867] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:32:21 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 17:32:21.179747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f3ce26d-ad0c-4676-93a6-3c0316ea5ebf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:21.180327 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f3ce26d-ad0c-4676-93a6-3c0316ea5ebf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:21.183555 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:21.187090 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3ce26d-ad0c-4676-93a6-3c0316ea5ebf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:21.187569 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3ce26d-ad0c-4676-93a6-3c0316ea5ebf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:21.188238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3ce26d-ad0c-4676-93a6-3c0316ea5ebf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:21.188930 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3ce26d-ad0c-4676-93a6-3c0316ea5ebf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:21.189570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3ce26d-ad0c-4676-93a6-3c0316ea5ebf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:21.190096 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3ce26d-ad0c-4676-93a6-3c0316ea5ebf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:21.219671 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f3ce26d-ad0c-4676-93a6-3c0316ea5ebf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:32:21.504818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f3ce26d-ad0c-4676-93a6-3c0316ea5ebf tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 204 len: 0 microversion: 2.1 time: 0.328565 Sep 19 17:32:21.505845 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 429/868] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:32:21 2022] DELETE /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:32:21.515127 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29ef44f4-f217-428d-9c75-2d82cbe2a222 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:21.517086 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-29ef44f4-f217-428d-9c75-2d82cbe2a222 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:21.522334 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ef44f4-f217-428d-9c75-2d82cbe2a222 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:21.522830 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ef44f4-f217-428d-9c75-2d82cbe2a222 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:21.523276 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ef44f4-f217-428d-9c75-2d82cbe2a222 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:21.524006 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ef44f4-f217-428d-9c75-2d82cbe2a222 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:21.525037 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ef44f4-f217-428d-9c75-2d82cbe2a222 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:21.525466 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ef44f4-f217-428d-9c75-2d82cbe2a222 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:21.747456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-29ef44f4-f217-428d-9c75-2d82cbe2a222 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:21.753930 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-29ef44f4-f217-428d-9c75-2d82cbe2a222 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1674 microversion: 2.1 time: 0.243516 Sep 19 17:32:21.768186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 440/869] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:21 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1674 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:22.785551 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6d3d582a-8a19-4b46-93d5-5018eb11e8d6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:22.787679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6d3d582a-8a19-4b46-93d5-5018eb11e8d6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:22.801316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d3d582a-8a19-4b46-93d5-5018eb11e8d6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:22.805548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d3d582a-8a19-4b46-93d5-5018eb11e8d6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:22.806028 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d3d582a-8a19-4b46-93d5-5018eb11e8d6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:22.806848 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d3d582a-8a19-4b46-93d5-5018eb11e8d6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:22.807284 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d3d582a-8a19-4b46-93d5-5018eb11e8d6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:22.807755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d3d582a-8a19-4b46-93d5-5018eb11e8d6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:22.992315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6d3d582a-8a19-4b46-93d5-5018eb11e8d6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:23.000925 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6d3d582a-8a19-4b46-93d5-5018eb11e8d6 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1674 microversion: 2.1 time: 0.226369 Sep 19 17:32:23.002641 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 430/870] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:22 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1674 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:23.177429 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc7f50fa-39ce-492a-b511-c0e1cce39d6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: .version_select at 0x7fd4d5de4e50>, body: {"keypair": {"name": "tempest-keypair-4746610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBXWfjyt4Jb/hL9ixWr3hlKxOeNLH4NHfIx/0L9iGaoeknUrLDw9kpNQtXzE2sdYvhsjHaLVOxVmf0ptgjI2e78SWvS5JxSCGf3W9ycTB5lvBTj5nm1ArBqjo3VZKkI5w=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:23.193497 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-bc7f50fa-39ce-492a-b511-c0e1cce39d6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:32:23.198014 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-bc7f50fa-39ce-492a-b511-c0e1cce39d6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for user a8e4233c03174fa18deb6baad431543b and project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:32:23.282610 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bc7f50fa-39ce-492a-b511-c0e1cce39d6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.222755 Sep 19 17:32:23.283461 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 441/871] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Sep 19 17:32:23 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:24.025716 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-efad67b9-8cc2-48a4-b2af-3436f75cebc1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:24.026514 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-efad67b9-8cc2-48a4-b2af-3436f75cebc1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:24.047565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efad67b9-8cc2-48a4-b2af-3436f75cebc1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:24.048162 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efad67b9-8cc2-48a4-b2af-3436f75cebc1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:24.048796 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efad67b9-8cc2-48a4-b2af-3436f75cebc1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:24.049475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efad67b9-8cc2-48a4-b2af-3436f75cebc1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:24.050016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efad67b9-8cc2-48a4-b2af-3436f75cebc1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:24.051034 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efad67b9-8cc2-48a4-b2af-3436f75cebc1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:24.139020 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-efad67b9-8cc2-48a4-b2af-3436f75cebc1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:24.139020 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-efad67b9-8cc2-48a4-b2af-3436f75cebc1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1606 microversion: 2.1 time: 0.117594 Sep 19 17:32:24.143735 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 431/872] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:24 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1606 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:24.224606 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-55fd7838-5138-4e4b-867d-f68b3e86ae2d req-4f04d454-ff5b-4640-a6f2-bd96d90c27e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33b5624-bc7c-4818-8aa5-584440fe803b", "name": "network-vif-deleted", "tag": "ed6a68bf-6926-4da7-bc07-84b7931a4dbc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:24.243763 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-55fd7838-5138-4e4b-867d-f68b3e86ae2d req-4f04d454-ff5b-4640-a6f2-bd96d90c27e9 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:24.244257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-55fd7838-5138-4e4b-867d-f68b3e86ae2d req-4f04d454-ff5b-4640-a6f2-bd96d90c27e9 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:24.244683 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-55fd7838-5138-4e4b-867d-f68b3e86ae2d req-4f04d454-ff5b-4640-a6f2-bd96d90c27e9 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:24.297408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-55fd7838-5138-4e4b-867d-f68b3e86ae2d req-4f04d454-ff5b-4640-a6f2-bd96d90c27e9 service nova] Creating event network-vif-deleted:ed6a68bf-6926-4da7-bc07-84b7931a4dbc for instance e33b5624-bc7c-4818-8aa5-584440fe803b on hv-cinder-84801 Sep 19 17:32:24.307688 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-55fd7838-5138-4e4b-867d-f68b3e86ae2d req-4f04d454-ff5b-4640-a6f2-bd96d90c27e9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088312 Sep 19 17:32:24.309276 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 442/873] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:25.164654 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:25.167464 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:25.172324 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:25.172807 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:25.173242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:25.173964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:25.174440 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:25.174993 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:25.214376 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:25.214869 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:25.215335 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:25.215801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lazy-loading 'fault' on Instance uuid e33b5624-bc7c-4818-8aa5-584440fe803b {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:32:25.304265 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:25.315967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-53933379-5235-494c-a97b-5c871d64668f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 200 len: 1326 microversion: 2.1 time: 0.155112 Sep 19 17:32:25.327775 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 432/874] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:25 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 1326 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:26.046413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2005504187", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee3141f2-3b76-40de-a3df-4fd096ef3d26"}], "security_groups": [{"name": "tempest-securitygroup--786036692"}], "key_name": "tempest-keypair-4746610", "user_data": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:26.167943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] validate_networks() for [('ee3141f2-3b76-40de-a3df-4fd096ef3d26', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:32:26.342391 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:26.346798 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:26.354481 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:26.355301 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:26.356452 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:26.357163 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:26.357631 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:26.358060 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:26.384018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] HTTP exception thrown: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Request method failure captured: Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b HTTP/1.1 Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKXuRNHo653P_P7ft4Su0SDlR9SpNGM4bSV6VFfZeMEH8eHiGGbmo260h3sz4OyuM27Q9DK4BRmZzd8fuGK72q-DlYgYSJJ8SlUmkZ2aqq36jAigmj0ZUvtM5Ab7NJl8O-aDyRwsD1B8jkZ9HrGLN5nfmiopUkUE_2Us4HVSfNaPl0M Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:32:26.385696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}] Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 69e1832300e44d20be53e84933b97faa Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:32:26.387407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': 'e33b5624-bc7c-4818-8aa5-584440fe803b'} Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:32:26.388409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:32:26.390203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:32:26.392431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Returning 404 to user: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:32:26.393312 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3372f47b-6c76-4aad-a064-7269e49f2b30 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 404 len: 111 microversion: 2.1 time: 0.054937 Sep 19 17:32:26.393886 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 433/875] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:26 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 17:32:26.402813 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a03787c1-67ae-433f-af63-0774840504fe tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '.version_select at 0x7fd4d5fd88b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:26.506934 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a03787c1-67ae-433f-af63-0774840504fe tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-606628555" status: 202 len: 0 microversion: 2.1 time: 0.108334 Sep 19 17:32:26.507729 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 434/876] 10.222.0.61 () {58 vars in 1218 bytes} [Mon Sep 19 17:32:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-606628555 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 17:32:26.905562 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:32:26.905983 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:32:26.906459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:32:26.906867 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:32:26.907278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:32:26.917027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:26.918655 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:26.918655 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:26.918969 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:26.919386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:26.919838 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:26.937404 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:32:26.941846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for user a8e4233c03174fa18deb6baad431543b and project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:32:26.954041 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:32:26.956505 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:32:27.090690 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a9108619-3f38-4535-8833-6955adb6c227 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.049872 Sep 19 17:32:27.092360 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 443/877] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:32:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:32:27.103383 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-23b5cca8-bd89-49cd-81b4-a9d15ec9d0b9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:27.107305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-23b5cca8-bd89-49cd-81b4-a9d15ec9d0b9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:27.156744 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-23b5cca8-bd89-49cd-81b4-a9d15ec9d0b9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:27.164717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-23b5cca8-bd89-49cd-81b4-a9d15ec9d0b9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1239 microversion: 2.1 time: 0.065149 Sep 19 17:32:27.165797 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 435/878] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:27 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:27.366861 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea59f635-e1b2-4721-9c48-9cf90f5f0d8c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Action: 'create', calling method: .version_select at 0x7fd4d60aa0d0>, body: {"keypair": {"name": "tempest-keypair-1314343545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRZ/WqBinCkS1CovNfe9LpxJcB/rx029XI03bKb62m/sBfatvFXgJE0h6egF85KdiaiIlPB0xZQORPD1CIj61F2NdySb4NZLWPwqDTvD6FnNcJCtqYyqE33tRuabLVlkg=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:27.384300 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-ea59f635-e1b2-4721-9c48-9cf90f5f0d8c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Getting quotas for project 4225a4c3567f43208ad1663eec41c56d. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:32:27.388499 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-ea59f635-e1b2-4721-9c48-9cf90f5f0d8c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Getting quotas for user 69e1832300e44d20be53e84933b97faa and project 4225a4c3567f43208ad1663eec41c56d. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:32:27.500637 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea59f635-e1b2-4721-9c48-9cf90f5f0d8c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137634 Sep 19 17:32:27.501336 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 444/879] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Sep 19 17:32:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:28.189128 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a6d903e-6f4e-4d8c-af39-4165feaa9485 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:28.189921 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a6d903e-6f4e-4d8c-af39-4165feaa9485 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:28.197295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a6d903e-6f4e-4d8c-af39-4165feaa9485 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:28.197782 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a6d903e-6f4e-4d8c-af39-4165feaa9485 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:28.198219 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a6d903e-6f4e-4d8c-af39-4165feaa9485 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:28.198964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a6d903e-6f4e-4d8c-af39-4165feaa9485 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:28.199416 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a6d903e-6f4e-4d8c-af39-4165feaa9485 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:28.199873 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a6d903e-6f4e-4d8c-af39-4165feaa9485 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:28.269150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a6d903e-6f4e-4d8c-af39-4165feaa9485 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:28.278635 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a6d903e-6f4e-4d8c-af39-4165feaa9485 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1243 microversion: 2.1 time: 0.093463 Sep 19 17:32:28.279220 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 436/880] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:28 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1243 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:29.307070 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c7e0bec3-c59b-4732-b489-242bc9fdd9f0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:29.307835 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c7e0bec3-c59b-4732-b489-242bc9fdd9f0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:29.314596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7e0bec3-c59b-4732-b489-242bc9fdd9f0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:29.315090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7e0bec3-c59b-4732-b489-242bc9fdd9f0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:29.315532 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7e0bec3-c59b-4732-b489-242bc9fdd9f0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:29.316267 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7e0bec3-c59b-4732-b489-242bc9fdd9f0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:29.316722 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7e0bec3-c59b-4732-b489-242bc9fdd9f0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:29.317151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7e0bec3-c59b-4732-b489-242bc9fdd9f0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:29.385809 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c7e0bec3-c59b-4732-b489-242bc9fdd9f0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:29.395193 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c7e0bec3-c59b-4732-b489-242bc9fdd9f0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1291 microversion: 2.1 time: 0.091359 Sep 19 17:32:29.395782 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 445/881] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:29 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1291 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:29.899511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1101633260", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63313b22-203d-445f-8d13-359752f5c140"}], "security_groups": [{"name": "tempest-securitygroup--1122794355"}], "key_name": "tempest-keypair-1314343545", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:30.003073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] validate_networks() for [('63313b22-203d-445f-8d13-359752f5c140', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:32:30.405347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:32:30.405910 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:32:30.406530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:32:30.407047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:32:30.407566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:32:30.419419 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:30.419671 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bd0c7de6-7817-444b-849a-5e1689af3c6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:30.420249 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bd0c7de6-7817-444b-849a-5e1689af3c6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:30.421026 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:30.421822 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:30.423017 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:30.423745 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:30.424453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:30.429251 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0c7de6-7817-444b-849a-5e1689af3c6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:30.429744 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0c7de6-7817-444b-849a-5e1689af3c6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:30.430407 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0c7de6-7817-444b-849a-5e1689af3c6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:30.431902 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0c7de6-7817-444b-849a-5e1689af3c6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:30.432756 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0c7de6-7817-444b-849a-5e1689af3c6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:30.433670 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0c7de6-7817-444b-849a-5e1689af3c6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:30.450556 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Getting quotas for project 4225a4c3567f43208ad1663eec41c56d. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:32:30.456387 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Getting quotas for user 69e1832300e44d20be53e84933b97faa and project 4225a4c3567f43208ad1663eec41c56d. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:32:30.469849 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:32:30.472675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:32:30.507719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd0c7de6-7817-444b-849a-5e1689af3c6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:30.515752 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bd0c7de6-7817-444b-849a-5e1689af3c6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1297 microversion: 2.1 time: 0.100931 Sep 19 17:32:30.516584 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 446/882] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:30 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:32:30.576356 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-94eca19d-219a-442a-b4f2-7bb65f55bc57 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.681083 Sep 19 17:32:30.577030 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 437/883] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:32:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:32:30.588359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fbc6e7ff-f635-4457-a2bf-e55ece634152 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:30.588971 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fbc6e7ff-f635-4457-a2bf-e55ece634152 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:30.666573 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-fbc6e7ff-f635-4457-a2bf-e55ece634152 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:30.676926 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fbc6e7ff-f635-4457-a2bf-e55ece634152 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1238 microversion: 2.1 time: 0.092635 Sep 19 17:32:30.677868 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 447/884] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:30 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:31.541409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1261cc38-5f94-4175-89dc-1fdd8c81a73a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:31.542053 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1261cc38-5f94-4175-89dc-1fdd8c81a73a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:31.548543 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1261cc38-5f94-4175-89dc-1fdd8c81a73a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:31.549028 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1261cc38-5f94-4175-89dc-1fdd8c81a73a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:31.549462 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1261cc38-5f94-4175-89dc-1fdd8c81a73a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:31.550161 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1261cc38-5f94-4175-89dc-1fdd8c81a73a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:31.550618 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1261cc38-5f94-4175-89dc-1fdd8c81a73a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:31.551040 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1261cc38-5f94-4175-89dc-1fdd8c81a73a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:31.683807 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1261cc38-5f94-4175-89dc-1fdd8c81a73a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:31.691864 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1261cc38-5f94-4175-89dc-1fdd8c81a73a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1364 microversion: 2.1 time: 0.155137 Sep 19 17:32:31.692648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 438/885] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:31 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:31.701643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-02ad9757-51aa-4786-8b54-36245155a9a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:31.702904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-02ad9757-51aa-4786-8b54-36245155a9a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:31.723031 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-aaeead73-5863-4aed-9624-47788872fb60 req-c222ff04-52ca-42ea-af14-19407217c5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a67add5-c558-4f0e-ad79-5b1683cfbee3", "tag": "3176241b-1c1c-41c5-babe-9aaf4adb08fe"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:31.747138 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aaeead73-5863-4aed-9624-47788872fb60 req-c222ff04-52ca-42ea-af14-19407217c5a9 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:31.747832 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aaeead73-5863-4aed-9624-47788872fb60 req-c222ff04-52ca-42ea-af14-19407217c5a9 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:31.748770 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aaeead73-5863-4aed-9624-47788872fb60 req-c222ff04-52ca-42ea-af14-19407217c5a9 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:31.761985 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-aaeead73-5863-4aed-9624-47788872fb60 req-c222ff04-52ca-42ea-af14-19407217c5a9 service nova] Creating event network-changed:3176241b-1c1c-41c5-babe-9aaf4adb08fe for instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 on hv-cinder-84801 Sep 19 17:32:31.769006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-aaeead73-5863-4aed-9624-47788872fb60 req-c222ff04-52ca-42ea-af14-19407217c5a9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048638 Sep 19 17:32:31.770540 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 439/886] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:32:31.872582 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02ad9757-51aa-4786-8b54-36245155a9a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:31.873075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02ad9757-51aa-4786-8b54-36245155a9a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:31.873515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02ad9757-51aa-4786-8b54-36245155a9a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:31.874223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02ad9757-51aa-4786-8b54-36245155a9a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:31.874673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02ad9757-51aa-4786-8b54-36245155a9a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:31.875096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02ad9757-51aa-4786-8b54-36245155a9a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:31.939537 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-02ad9757-51aa-4786-8b54-36245155a9a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:31.947918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-02ad9757-51aa-4786-8b54-36245155a9a2 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1242 microversion: 2.1 time: 0.250020 Sep 19 17:32:31.948711 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 448/887] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:31 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1242 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:32.715608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da9d8dff-4315-4fad-bff3-05e8f6fa0762 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:32.716440 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-da9d8dff-4315-4fad-bff3-05e8f6fa0762 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:32.724078 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9d8dff-4315-4fad-bff3-05e8f6fa0762 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:32.724308 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9d8dff-4315-4fad-bff3-05e8f6fa0762 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:32.725014 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9d8dff-4315-4fad-bff3-05e8f6fa0762 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:32.725258 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9d8dff-4315-4fad-bff3-05e8f6fa0762 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:32.725713 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9d8dff-4315-4fad-bff3-05e8f6fa0762 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:32.726137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9d8dff-4315-4fad-bff3-05e8f6fa0762 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:32.861678 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-da9d8dff-4315-4fad-bff3-05e8f6fa0762 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:32.869917 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da9d8dff-4315-4fad-bff3-05e8f6fa0762 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1364 microversion: 2.1 time: 0.159124 Sep 19 17:32:32.870495 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 440/888] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:32 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:32.970563 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04049243-2c57-4d9d-b684-818a0ba420d5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:32.971160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04049243-2c57-4d9d-b684-818a0ba420d5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:32.978282 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04049243-2c57-4d9d-b684-818a0ba420d5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:32.978772 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04049243-2c57-4d9d-b684-818a0ba420d5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:32.979206 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04049243-2c57-4d9d-b684-818a0ba420d5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:32.979925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04049243-2c57-4d9d-b684-818a0ba420d5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:32.980377 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04049243-2c57-4d9d-b684-818a0ba420d5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:32.980795 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04049243-2c57-4d9d-b684-818a0ba420d5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:33.053321 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-04049243-2c57-4d9d-b684-818a0ba420d5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:33.061224 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04049243-2c57-4d9d-b684-818a0ba420d5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1298 microversion: 2.1 time: 0.094538 Sep 19 17:32:33.061728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 449/889] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:32 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:33.893505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b251e695-807b-4a20-8049-f68ed2293453 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:33.894157 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b251e695-807b-4a20-8049-f68ed2293453 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:33.900623 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b251e695-807b-4a20-8049-f68ed2293453 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:33.901112 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b251e695-807b-4a20-8049-f68ed2293453 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:33.901557 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b251e695-807b-4a20-8049-f68ed2293453 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:33.902254 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b251e695-807b-4a20-8049-f68ed2293453 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:33.902713 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b251e695-807b-4a20-8049-f68ed2293453 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:33.903142 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b251e695-807b-4a20-8049-f68ed2293453 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:34.029375 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b251e695-807b-4a20-8049-f68ed2293453 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:34.037367 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b251e695-807b-4a20-8049-f68ed2293453 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1364 microversion: 2.1 time: 0.148416 Sep 19 17:32:34.037987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 441/890] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:33 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:34.084289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c2fb473-4f8d-420f-8d3c-6572ac99e6f3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:34.084901 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c2fb473-4f8d-420f-8d3c-6572ac99e6f3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:34.091967 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c2fb473-4f8d-420f-8d3c-6572ac99e6f3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:34.092455 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c2fb473-4f8d-420f-8d3c-6572ac99e6f3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:34.092923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c2fb473-4f8d-420f-8d3c-6572ac99e6f3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:34.093621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c2fb473-4f8d-420f-8d3c-6572ac99e6f3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:34.094078 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c2fb473-4f8d-420f-8d3c-6572ac99e6f3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:34.094505 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c2fb473-4f8d-420f-8d3c-6572ac99e6f3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:34.154736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c2fb473-4f8d-420f-8d3c-6572ac99e6f3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:34.162449 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c2fb473-4f8d-420f-8d3c-6572ac99e6f3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1308 microversion: 2.1 time: 0.082005 Sep 19 17:32:34.163002 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 450/891] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:34 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1308 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:35.060763 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14e1532d-4bde-4a3f-a5fa-93a0879f08db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:35.061380 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14e1532d-4bde-4a3f-a5fa-93a0879f08db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:35.067842 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14e1532d-4bde-4a3f-a5fa-93a0879f08db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:35.068329 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14e1532d-4bde-4a3f-a5fa-93a0879f08db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:35.068772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14e1532d-4bde-4a3f-a5fa-93a0879f08db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:35.069464 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14e1532d-4bde-4a3f-a5fa-93a0879f08db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:35.069919 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14e1532d-4bde-4a3f-a5fa-93a0879f08db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:35.070345 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14e1532d-4bde-4a3f-a5fa-93a0879f08db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:35.073599 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:35.185702 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e7ea0ca1-9d64-4260-8423-c21519b9a9da tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:35.186976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e7ea0ca1-9d64-4260-8423-c21519b9a9da tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:35.193482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7ea0ca1-9d64-4260-8423-c21519b9a9da tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:35.193976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7ea0ca1-9d64-4260-8423-c21519b9a9da tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:35.194602 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7ea0ca1-9d64-4260-8423-c21519b9a9da tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:35.195314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7ea0ca1-9d64-4260-8423-c21519b9a9da tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:35.195807 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7ea0ca1-9d64-4260-8423-c21519b9a9da tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:35.196248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7ea0ca1-9d64-4260-8423-c21519b9a9da tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:35.204944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-14e1532d-4bde-4a3f-a5fa-93a0879f08db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:35.212704 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14e1532d-4bde-4a3f-a5fa-93a0879f08db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1364 microversion: 2.1 time: 0.156301 Sep 19 17:32:35.213299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 442/892] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:35 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:35.256471 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e7ea0ca1-9d64-4260-8423-c21519b9a9da tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:35.264846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e7ea0ca1-9d64-4260-8423-c21519b9a9da tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1308 microversion: 2.1 time: 0.083165 Sep 19 17:32:35.265419 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 451/893] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:35 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1308 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:32:36.236560 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40c8f020-16f2-4054-ae6a-f790808a8b6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:36.237384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-40c8f020-16f2-4054-ae6a-f790808a8b6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:36.245161 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c8f020-16f2-4054-ae6a-f790808a8b6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:36.245610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c8f020-16f2-4054-ae6a-f790808a8b6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:36.246625 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c8f020-16f2-4054-ae6a-f790808a8b6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:36.246755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c8f020-16f2-4054-ae6a-f790808a8b6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:36.247204 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c8f020-16f2-4054-ae6a-f790808a8b6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:36.247660 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c8f020-16f2-4054-ae6a-f790808a8b6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:36.288611 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-145cbb46-5e91-4fd6-8357-f8a1dceef84d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:36.289641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-145cbb46-5e91-4fd6-8357-f8a1dceef84d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:36.300184 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145cbb46-5e91-4fd6-8357-f8a1dceef84d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:36.300687 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145cbb46-5e91-4fd6-8357-f8a1dceef84d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:36.301123 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145cbb46-5e91-4fd6-8357-f8a1dceef84d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:36.301828 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145cbb46-5e91-4fd6-8357-f8a1dceef84d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:36.302321 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145cbb46-5e91-4fd6-8357-f8a1dceef84d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:36.302771 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145cbb46-5e91-4fd6-8357-f8a1dceef84d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:36.479569 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-40c8f020-16f2-4054-ae6a-f790808a8b6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:36.488817 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-40c8f020-16f2-4054-ae6a-f790808a8b6c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1364 microversion: 2.1 time: 0.256122 Sep 19 17:32:36.494644 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 443/894] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:36 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:36.533186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-145cbb46-5e91-4fd6-8357-f8a1dceef84d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:36.542566 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-145cbb46-5e91-4fd6-8357-f8a1dceef84d tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1364 microversion: 2.1 time: 0.259886 Sep 19 17:32:36.543156 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 452/895] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:36 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:32:37.240997 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-04f8735d-d063-4c20-bc35-c21312d5123e req-06938e09-7e87-4278-85b0-bb80e2f573d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "804ecd62-8779-426a-9cea-e9b6cef8b4b8", "tag": "347bef90-4a8a-425d-8f92-3356b072b80d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:37.252637 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-04f8735d-d063-4c20-bc35-c21312d5123e req-06938e09-7e87-4278-85b0-bb80e2f573d4 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:37.253452 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-04f8735d-d063-4c20-bc35-c21312d5123e req-06938e09-7e87-4278-85b0-bb80e2f573d4 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:37.253877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-04f8735d-d063-4c20-bc35-c21312d5123e req-06938e09-7e87-4278-85b0-bb80e2f573d4 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:37.266243 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-04f8735d-d063-4c20-bc35-c21312d5123e req-06938e09-7e87-4278-85b0-bb80e2f573d4 service nova] Creating event network-changed:347bef90-4a8a-425d-8f92-3356b072b80d for instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 on hv-cinder-84801 Sep 19 17:32:37.271146 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-04f8735d-d063-4c20-bc35-c21312d5123e req-06938e09-7e87-4278-85b0-bb80e2f573d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033836 Sep 19 17:32:37.271774 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 444/896] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:37.513390 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e1299e90-7326-48ff-bcbf-8dbf90312de2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:37.514062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e1299e90-7326-48ff-bcbf-8dbf90312de2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:37.516258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:37.522056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1299e90-7326-48ff-bcbf-8dbf90312de2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:37.522636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1299e90-7326-48ff-bcbf-8dbf90312de2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:37.523042 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1299e90-7326-48ff-bcbf-8dbf90312de2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:37.523784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1299e90-7326-48ff-bcbf-8dbf90312de2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:37.524245 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1299e90-7326-48ff-bcbf-8dbf90312de2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:37.524682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1299e90-7326-48ff-bcbf-8dbf90312de2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:37.565923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c20022e9-471a-4d1e-9994-14e504a084e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:37.566634 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c20022e9-471a-4d1e-9994-14e504a084e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:37.575981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20022e9-471a-4d1e-9994-14e504a084e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:37.576919 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20022e9-471a-4d1e-9994-14e504a084e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:37.577627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20022e9-471a-4d1e-9994-14e504a084e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:37.578506 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20022e9-471a-4d1e-9994-14e504a084e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:37.579269 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20022e9-471a-4d1e-9994-14e504a084e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:37.580024 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20022e9-471a-4d1e-9994-14e504a084e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:37.747963 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e1299e90-7326-48ff-bcbf-8dbf90312de2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:37.755840 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e1299e90-7326-48ff-bcbf-8dbf90312de2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1364 microversion: 2.1 time: 0.246941 Sep 19 17:32:37.756492 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 453/897] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:37 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:37.800803 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c20022e9-471a-4d1e-9994-14e504a084e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:37.808780 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c20022e9-471a-4d1e-9994-14e504a084e5 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1364 microversion: 2.1 time: 0.246893 Sep 19 17:32:37.809236 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 445/898] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:37 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:32:38.715631 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-75c23d7c-c48b-4727-9aaf-202e8df72026 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:38.716242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-75c23d7c-c48b-4727-9aaf-202e8df72026 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:38.722586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75c23d7c-c48b-4727-9aaf-202e8df72026 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:38.723072 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75c23d7c-c48b-4727-9aaf-202e8df72026 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:38.723510 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75c23d7c-c48b-4727-9aaf-202e8df72026 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:38.724228 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75c23d7c-c48b-4727-9aaf-202e8df72026 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:38.724684 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75c23d7c-c48b-4727-9aaf-202e8df72026 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:38.725109 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75c23d7c-c48b-4727-9aaf-202e8df72026 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:38.748117 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-75c23d7c-c48b-4727-9aaf-202e8df72026 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/ips" status: 200 len: 151 microversion: 2.20 time: 0.036972 Sep 19 17:32:38.748676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 454/899] 10.222.0.61 () {60 vars in 1289 bytes} [Mon Sep 19 17:32:38 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 17:32:38.779868 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5020d477-368a-4367-9471-2b8e39ef8139 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:38.780492 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5020d477-368a-4367-9471-2b8e39ef8139 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:38.786901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5020d477-368a-4367-9471-2b8e39ef8139 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:38.787388 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5020d477-368a-4367-9471-2b8e39ef8139 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:38.787886 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5020d477-368a-4367-9471-2b8e39ef8139 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:38.788551 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5020d477-368a-4367-9471-2b8e39ef8139 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:38.789011 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5020d477-368a-4367-9471-2b8e39ef8139 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:38.789435 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5020d477-368a-4367-9471-2b8e39ef8139 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:38.833301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-19f8a947-950d-4a7f-a69b-5c832ed4e11e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:38.833923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-19f8a947-950d-4a7f-a69b-5c832ed4e11e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:38.840204 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19f8a947-950d-4a7f-a69b-5c832ed4e11e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:38.840702 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19f8a947-950d-4a7f-a69b-5c832ed4e11e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:38.841148 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19f8a947-950d-4a7f-a69b-5c832ed4e11e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:38.841864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19f8a947-950d-4a7f-a69b-5c832ed4e11e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:38.842323 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19f8a947-950d-4a7f-a69b-5c832ed4e11e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:38.842758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19f8a947-950d-4a7f-a69b-5c832ed4e11e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:38.975652 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5020d477-368a-4367-9471-2b8e39ef8139 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:38.984471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5020d477-368a-4367-9471-2b8e39ef8139 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1364 microversion: 2.1 time: 0.208429 Sep 19 17:32:39.000204 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 446/900] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:38 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:39.003609 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-19f8a947-950d-4a7f-a69b-5c832ed4e11e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:39.011278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-19f8a947-950d-4a7f-a69b-5c832ed4e11e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1364 microversion: 2.1 time: 0.183181 Sep 19 17:32:39.011874 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 455/901] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:38 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:32:39.387188 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f64ab122-4b4c-4f2a-8ee0-afa79b216837 req-116c3de0-2d01-4dce-9853-e31dfa0d3bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a67add5-c558-4f0e-ad79-5b1683cfbee3", "name": "network-vif-plugged", "status": "completed", "tag": "3176241b-1c1c-41c5-babe-9aaf4adb08fe"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:39.397916 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f64ab122-4b4c-4f2a-8ee0-afa79b216837 req-116c3de0-2d01-4dce-9853-e31dfa0d3bc0 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:39.398399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f64ab122-4b4c-4f2a-8ee0-afa79b216837 req-116c3de0-2d01-4dce-9853-e31dfa0d3bc0 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:39.398874 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f64ab122-4b4c-4f2a-8ee0-afa79b216837 req-116c3de0-2d01-4dce-9853-e31dfa0d3bc0 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:39.411366 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f64ab122-4b4c-4f2a-8ee0-afa79b216837 req-116c3de0-2d01-4dce-9853-e31dfa0d3bc0 service nova] Creating event network-vif-plugged:3176241b-1c1c-41c5-babe-9aaf4adb08fe for instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 on hv-cinder-84801 Sep 19 17:32:39.416503 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f64ab122-4b4c-4f2a-8ee0-afa79b216837 req-116c3de0-2d01-4dce-9853-e31dfa0d3bc0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034121 Sep 19 17:32:39.417271 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 447/902] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:40.006735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ee053b3a-72ed-4a4c-80bc-1e1c406f4817 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:40.007352 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ee053b3a-72ed-4a4c-80bc-1e1c406f4817 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:40.014368 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee053b3a-72ed-4a4c-80bc-1e1c406f4817 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:40.015112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee053b3a-72ed-4a4c-80bc-1e1c406f4817 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:40.015583 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee053b3a-72ed-4a4c-80bc-1e1c406f4817 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:40.016303 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee053b3a-72ed-4a4c-80bc-1e1c406f4817 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:40.016762 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee053b3a-72ed-4a4c-80bc-1e1c406f4817 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:40.017220 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee053b3a-72ed-4a4c-80bc-1e1c406f4817 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:40.035124 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8289bb1e-508a-4375-a772-0a1b411ff356 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:40.035880 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8289bb1e-508a-4375-a772-0a1b411ff356 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:40.042535 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8289bb1e-508a-4375-a772-0a1b411ff356 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:40.043026 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8289bb1e-508a-4375-a772-0a1b411ff356 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:40.043467 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8289bb1e-508a-4375-a772-0a1b411ff356 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:40.044356 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8289bb1e-508a-4375-a772-0a1b411ff356 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:40.044822 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8289bb1e-508a-4375-a772-0a1b411ff356 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:40.045280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8289bb1e-508a-4375-a772-0a1b411ff356 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:40.208003 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ee053b3a-72ed-4a4c-80bc-1e1c406f4817 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:40.216345 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ee053b3a-72ed-4a4c-80bc-1e1c406f4817 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1364 microversion: 2.1 time: 0.213512 Sep 19 17:32:40.217115 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 456/903] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:40 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:40.220419 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8289bb1e-508a-4375-a772-0a1b411ff356 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:40.229144 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8289bb1e-508a-4375-a772-0a1b411ff356 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1364 microversion: 2.1 time: 0.198358 Sep 19 17:32:40.231508 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 448/904] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:40 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:32:41.238847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-32376469-6964-45fc-9735-438e5f153f63 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:41.239522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-32376469-6964-45fc-9735-438e5f153f63 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:41.241440 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=16 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:41.247300 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32376469-6964-45fc-9735-438e5f153f63 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:41.247883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32376469-6964-45fc-9735-438e5f153f63 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:41.248762 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32376469-6964-45fc-9735-438e5f153f63 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:41.249082 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32376469-6964-45fc-9735-438e5f153f63 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:41.249549 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32376469-6964-45fc-9735-438e5f153f63 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:41.249994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32376469-6964-45fc-9735-438e5f153f63 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:41.252975 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-727d3284-cf6d-4a38-a24f-3044b2e79797 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:41.253860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-727d3284-cf6d-4a38-a24f-3044b2e79797 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:41.258296 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:41.258976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:41.264736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-727d3284-cf6d-4a38-a24f-3044b2e79797 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:41.265245 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-727d3284-cf6d-4a38-a24f-3044b2e79797 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:41.266280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-727d3284-cf6d-4a38-a24f-3044b2e79797 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:41.266429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-727d3284-cf6d-4a38-a24f-3044b2e79797 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:41.266844 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-727d3284-cf6d-4a38-a24f-3044b2e79797 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:41.267272 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-727d3284-cf6d-4a38-a24f-3044b2e79797 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:41.468318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-32376469-6964-45fc-9735-438e5f153f63 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:41.472111 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-727d3284-cf6d-4a38-a24f-3044b2e79797 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:41.476043 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-32376469-6964-45fc-9735-438e5f153f63 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1364 microversion: 2.1 time: 0.241088 Sep 19 17:32:41.482289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 457/905] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:41 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:41.482423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-727d3284-cf6d-4a38-a24f-3044b2e79797 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1364 microversion: 2.1 time: 0.231487 Sep 19 17:32:41.482423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 449/906] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:41 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:32:41.941978 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c02f755e-dd11-4e8a-b541-196c37685036 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:41.942540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c02f755e-dd11-4e8a-b541-196c37685036 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:41.949209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02f755e-dd11-4e8a-b541-196c37685036 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:41.949689 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02f755e-dd11-4e8a-b541-196c37685036 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:41.950126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02f755e-dd11-4e8a-b541-196c37685036 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:41.950815 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02f755e-dd11-4e8a-b541-196c37685036 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:41.951268 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02f755e-dd11-4e8a-b541-196c37685036 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:41.951715 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c02f755e-dd11-4e8a-b541-196c37685036 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:41.973531 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c02f755e-dd11-4e8a-b541-196c37685036 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lazy-loading 'flavor' on Instance uuid 70bea192-300a-4359-90a1-81ad16a35d10 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:32:42.091273 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:42.504341 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a0564309-4f22-44d5-9800-96f374d6ae2a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:42.504921 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a0564309-4f22-44d5-9800-96f374d6ae2a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:42.511756 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0564309-4f22-44d5-9800-96f374d6ae2a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:42.512472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0564309-4f22-44d5-9800-96f374d6ae2a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:42.512893 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0564309-4f22-44d5-9800-96f374d6ae2a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:42.513603 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0564309-4f22-44d5-9800-96f374d6ae2a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:42.514150 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0564309-4f22-44d5-9800-96f374d6ae2a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:42.514871 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0564309-4f22-44d5-9800-96f374d6ae2a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:42.523146 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c02f755e-dd11-4e8a-b541-196c37685036 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "POST /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/action" status: 202 len: 0 microversion: 2.20 time: 0.584979 Sep 19 17:32:42.524028 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 458/907] 10.222.0.61 () {62 vars in 1319 bytes} [Mon Sep 19 17:32:41 2022] POST /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:32:42.529407 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-34fe59f8-cabb-45cd-86c0-da0358868232 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:42.530228 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-34fe59f8-cabb-45cd-86c0-da0358868232 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:42.537510 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34fe59f8-cabb-45cd-86c0-da0358868232 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:42.540035 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34fe59f8-cabb-45cd-86c0-da0358868232 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:42.540035 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34fe59f8-cabb-45cd-86c0-da0358868232 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:42.540035 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34fe59f8-cabb-45cd-86c0-da0358868232 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:42.540035 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34fe59f8-cabb-45cd-86c0-da0358868232 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:42.540438 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34fe59f8-cabb-45cd-86c0-da0358868232 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:42.714981 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a0564309-4f22-44d5-9800-96f374d6ae2a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:42.722053 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-34fe59f8-cabb-45cd-86c0-da0358868232 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:42.723290 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a0564309-4f22-44d5-9800-96f374d6ae2a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1364 microversion: 2.1 time: 0.223476 Sep 19 17:32:42.723909 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 450/908] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:42 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:42.728978 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:42.729577 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:42.735041 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-34fe59f8-cabb-45cd-86c0-da0358868232 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1364 microversion: 2.1 time: 0.209952 Sep 19 17:32:42.740627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:42.741010 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 459/909] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:42 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:42.741121 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:42.741121 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:42.741121 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:42.741121 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:42.741453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:42.866991 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:42.875530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:42.876997 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:42.878166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be2eaaed-f3dd-42bc-9c3f-82cc23531930 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.153333 Sep 19 17:32:42.878725 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 451/910] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:42 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:43.747518 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-478c3d8a-e3d3-4fa2-a5c9-49ea65e1e028 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:43.748073 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-478c3d8a-e3d3-4fa2-a5c9-49ea65e1e028 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:43.754893 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478c3d8a-e3d3-4fa2-a5c9-49ea65e1e028 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:43.755391 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478c3d8a-e3d3-4fa2-a5c9-49ea65e1e028 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:43.755946 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478c3d8a-e3d3-4fa2-a5c9-49ea65e1e028 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:43.756661 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478c3d8a-e3d3-4fa2-a5c9-49ea65e1e028 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:43.757126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478c3d8a-e3d3-4fa2-a5c9-49ea65e1e028 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:43.757547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478c3d8a-e3d3-4fa2-a5c9-49ea65e1e028 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:43.761269 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-833a5a7e-149b-4dc7-8b85-c198bae51e62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:43.762410 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-833a5a7e-149b-4dc7-8b85-c198bae51e62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:43.768822 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-833a5a7e-149b-4dc7-8b85-c198bae51e62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:43.769346 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-833a5a7e-149b-4dc7-8b85-c198bae51e62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:43.769785 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-833a5a7e-149b-4dc7-8b85-c198bae51e62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:43.770492 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-833a5a7e-149b-4dc7-8b85-c198bae51e62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:43.771129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-833a5a7e-149b-4dc7-8b85-c198bae51e62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:43.771564 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-833a5a7e-149b-4dc7-8b85-c198bae51e62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:43.938059 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-478c3d8a-e3d3-4fa2-a5c9-49ea65e1e028 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:43.945749 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-478c3d8a-e3d3-4fa2-a5c9-49ea65e1e028 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1553 microversion: 2.1 time: 0.202792 Sep 19 17:32:43.946326 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 460/911] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:43 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:43.950869 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:43.951472 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:43.957304 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:43.957792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:43.958233 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:43.958931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:43.959389 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:43.959845 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:43.962346 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-833a5a7e-149b-4dc7-8b85-c198bae51e62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:43.971511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-833a5a7e-149b-4dc7-8b85-c198bae51e62 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1364 microversion: 2.1 time: 0.214181 Sep 19 17:32:43.976366 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 452/912] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:43 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:43.977541 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-41e482a5-fb5c-4afe-a63b-340c64155913 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:43.978386 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-41e482a5-fb5c-4afe-a63b-340c64155913 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:43.985136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41e482a5-fb5c-4afe-a63b-340c64155913 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:43.986018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41e482a5-fb5c-4afe-a63b-340c64155913 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:43.986794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41e482a5-fb5c-4afe-a63b-340c64155913 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:43.987885 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41e482a5-fb5c-4afe-a63b-340c64155913 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:43.988662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41e482a5-fb5c-4afe-a63b-340c64155913 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:43.989301 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41e482a5-fb5c-4afe-a63b-340c64155913 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:44.340013 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-41e482a5-fb5c-4afe-a63b-340c64155913 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.366353 Sep 19 17:32:44.340681 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 453/913] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Sep 19 17:32:43 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-interface => generated 284 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:44.372986 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:44.381433 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:44.382870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:44.384105 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-61ffa7f0-af47-472c-94f0-f83b55e7e9bf tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.436812 Sep 19 17:32:44.388442 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 461/914] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:43 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:44.995907 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b8a9685-ca16-48c6-8769-3add23ab6de7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:44.996608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b8a9685-ca16-48c6-8769-3add23ab6de7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:45.002540 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b8a9685-ca16-48c6-8769-3add23ab6de7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:45.003062 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b8a9685-ca16-48c6-8769-3add23ab6de7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:45.003506 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b8a9685-ca16-48c6-8769-3add23ab6de7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:45.004239 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b8a9685-ca16-48c6-8769-3add23ab6de7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:45.004701 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b8a9685-ca16-48c6-8769-3add23ab6de7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:45.005134 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b8a9685-ca16-48c6-8769-3add23ab6de7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:45.139266 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b8a9685-ca16-48c6-8769-3add23ab6de7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:45.147341 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b8a9685-ca16-48c6-8769-3add23ab6de7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1364 microversion: 2.1 time: 0.156848 Sep 19 17:32:45.147958 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 454/915] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:44 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:45.310951 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-22176bec-df87-4854-a9cf-32f10f96ace3 req-1223c3f1-94f2-4993-bd20-8286e3da0385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a67add5-c558-4f0e-ad79-5b1683cfbee3", "tag": "3176241b-1c1c-41c5-babe-9aaf4adb08fe"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:45.321434 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-22176bec-df87-4854-a9cf-32f10f96ace3 req-1223c3f1-94f2-4993-bd20-8286e3da0385 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:45.322036 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-22176bec-df87-4854-a9cf-32f10f96ace3 req-1223c3f1-94f2-4993-bd20-8286e3da0385 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:45.322556 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-22176bec-df87-4854-a9cf-32f10f96ace3 req-1223c3f1-94f2-4993-bd20-8286e3da0385 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:45.337841 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-22176bec-df87-4854-a9cf-32f10f96ace3 req-1223c3f1-94f2-4993-bd20-8286e3da0385 service nova] Creating event network-changed:3176241b-1c1c-41c5-babe-9aaf4adb08fe for instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 on hv-cinder-84801 Sep 19 17:32:45.340577 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-22176bec-df87-4854-a9cf-32f10f96ace3 req-1223c3f1-94f2-4993-bd20-8286e3da0385 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033850 Sep 19 17:32:45.341189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 462/916] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:45.410554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:45.411166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:45.417890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:45.418497 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:45.422857 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:45.422857 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:45.422857 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:45.422857 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:45.500338 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-51462170-191c-471f-86c9-61017103ec35 req-fc5c6d53-e879-4d89-b292-e0afc9f9a3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "804ecd62-8779-426a-9cea-e9b6cef8b4b8", "name": "network-vif-plugged", "status": "completed", "tag": "347bef90-4a8a-425d-8f92-3356b072b80d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:45.510522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-51462170-191c-471f-86c9-61017103ec35 req-fc5c6d53-e879-4d89-b292-e0afc9f9a3a9 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:45.510983 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-51462170-191c-471f-86c9-61017103ec35 req-fc5c6d53-e879-4d89-b292-e0afc9f9a3a9 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:45.511667 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-51462170-191c-471f-86c9-61017103ec35 req-fc5c6d53-e879-4d89-b292-e0afc9f9a3a9 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:45.523753 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-51462170-191c-471f-86c9-61017103ec35 req-fc5c6d53-e879-4d89-b292-e0afc9f9a3a9 service nova] Creating event network-vif-plugged:347bef90-4a8a-425d-8f92-3356b072b80d for instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 on hv-cinder-84801 Sep 19 17:32:45.530143 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-51462170-191c-471f-86c9-61017103ec35 req-fc5c6d53-e879-4d89-b292-e0afc9f9a3a9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034072 Sep 19 17:32:45.531477 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 463/917] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:45.663492 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:45.673780 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:45.675461 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:45.677016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dcd5a264-f426-48f9-aef8-8aca1270297d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.270458 Sep 19 17:32:45.677724 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 455/918] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:45 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:46.170985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4241e319-76a5-489c-9e11-57316fe6cd89 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:46.171616 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4241e319-76a5-489c-9e11-57316fe6cd89 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:46.177804 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4241e319-76a5-489c-9e11-57316fe6cd89 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:46.178299 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4241e319-76a5-489c-9e11-57316fe6cd89 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:46.178732 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4241e319-76a5-489c-9e11-57316fe6cd89 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:46.179431 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4241e319-76a5-489c-9e11-57316fe6cd89 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:46.179913 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4241e319-76a5-489c-9e11-57316fe6cd89 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:46.180339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4241e319-76a5-489c-9e11-57316fe6cd89 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:46.315074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4241e319-76a5-489c-9e11-57316fe6cd89 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:46.323988 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4241e319-76a5-489c-9e11-57316fe6cd89 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1364 microversion: 2.1 time: 0.157325 Sep 19 17:32:46.324802 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 464/919] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:46 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:46.703001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:46.703552 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:46.710148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:46.710640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:46.711086 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:46.711833 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:46.712282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:46.712708 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:46.842714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:46.850770 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:46.852248 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:46.853421 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a4caa68a-facf-4cc7-a1fa-055a66bc5ee7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.154455 Sep 19 17:32:46.854487 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 456/920] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:46 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:47.346413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e38ae49-915c-43de-9941-66119941ba7a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:47.347019 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e38ae49-915c-43de-9941-66119941ba7a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:47.354232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e38ae49-915c-43de-9941-66119941ba7a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:47.354731 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e38ae49-915c-43de-9941-66119941ba7a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:47.355180 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e38ae49-915c-43de-9941-66119941ba7a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:47.355924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e38ae49-915c-43de-9941-66119941ba7a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:47.356411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e38ae49-915c-43de-9941-66119941ba7a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:47.356846 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e38ae49-915c-43de-9941-66119941ba7a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:47.485420 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-2e38ae49-915c-43de-9941-66119941ba7a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:47.493379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e38ae49-915c-43de-9941-66119941ba7a tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1364 microversion: 2.1 time: 0.150836 Sep 19 17:32:47.493983 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 465/921] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:47 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:47.879550 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:47.880190 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:47.886566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:47.887042 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:47.887478 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:47.888186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:47.888638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:47.889056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:48.019033 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:48.027649 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:48.029193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:48.030357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17995764-4143-4d3e-9477-c9be50d79b12 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.154885 Sep 19 17:32:48.030923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 457/922] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:47 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:48.517428 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f39d1592-816a-431f-95d0-7c7c6eff6746 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:48.518048 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f39d1592-816a-431f-95d0-7c7c6eff6746 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:48.524509 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f39d1592-816a-431f-95d0-7c7c6eff6746 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:48.524996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f39d1592-816a-431f-95d0-7c7c6eff6746 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:48.525435 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f39d1592-816a-431f-95d0-7c7c6eff6746 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:48.526130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f39d1592-816a-431f-95d0-7c7c6eff6746 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:48.526586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f39d1592-816a-431f-95d0-7c7c6eff6746 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:48.527015 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f39d1592-816a-431f-95d0-7c7c6eff6746 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:48.653480 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f39d1592-816a-431f-95d0-7c7c6eff6746 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:48.661263 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f39d1592-816a-431f-95d0-7c7c6eff6746 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1550 microversion: 2.1 time: 0.147913 Sep 19 17:32:48.661837 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 466/923] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:32:48 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:32:48.683862 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0f6b78c-f55a-4861-a4c6-82b9357681a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:48.684359 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b0f6b78c-f55a-4861-a4c6-82b9357681a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:48.690302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0f6b78c-f55a-4861-a4c6-82b9357681a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:48.690783 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0f6b78c-f55a-4861-a4c6-82b9357681a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:48.691218 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0f6b78c-f55a-4861-a4c6-82b9357681a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:48.691948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0f6b78c-f55a-4861-a4c6-82b9357681a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:48.692405 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0f6b78c-f55a-4861-a4c6-82b9357681a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:48.692836 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0f6b78c-f55a-4861-a4c6-82b9357681a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:48.769948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b0f6b78c-f55a-4861-a4c6-82b9357681a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090495 Sep 19 17:32:48.770553 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 458/924] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Sep 19 17:32:48 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:49.056674 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:49.057871 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:49.064106 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:49.064701 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:49.065181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:49.065893 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:49.066401 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:49.066841 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:49.277257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:49.285546 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:49.287074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:49.288256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a60f079e-89c2-464a-9f16-bd4de1c91172 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.235765 Sep 19 17:32:49.288832 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 467/925] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:49 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:49.896432 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-9eed51cf-b4b7-46ef-a707-c1c6a99761c4 req-5ea14c08-af04-4ff4-9ae9-2b7f52f0896a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "804ecd62-8779-426a-9cea-e9b6cef8b4b8", "tag": "347bef90-4a8a-425d-8f92-3356b072b80d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:32:49.906556 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9eed51cf-b4b7-46ef-a707-c1c6a99761c4 req-5ea14c08-af04-4ff4-9ae9-2b7f52f0896a service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:49.907040 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9eed51cf-b4b7-46ef-a707-c1c6a99761c4 req-5ea14c08-af04-4ff4-9ae9-2b7f52f0896a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:49.907484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9eed51cf-b4b7-46ef-a707-c1c6a99761c4 req-5ea14c08-af04-4ff4-9ae9-2b7f52f0896a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:49.918805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-9eed51cf-b4b7-46ef-a707-c1c6a99761c4 req-5ea14c08-af04-4ff4-9ae9-2b7f52f0896a service nova] Creating event network-changed:347bef90-4a8a-425d-8f92-3356b072b80d for instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 on hv-cinder-84801 Sep 19 17:32:49.924511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-9eed51cf-b4b7-46ef-a707-c1c6a99761c4 req-5ea14c08-af04-4ff4-9ae9-2b7f52f0896a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032293 Sep 19 17:32:49.925187 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 459/926] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:32:50.314673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:50.315353 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:50.322038 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:50.323118 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:50.323804 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:50.324520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:50.325151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:50.325588 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:50.540096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:50.549766 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:50.551210 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:50.552447 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0b41d02-407e-4e80-8347-cec96d33c12c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.241879 Sep 19 17:32:50.553005 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 468/927] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:50 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:32:51.579578 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:51.580305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:51.587099 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:51.587588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:51.588052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:51.588737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:51.589189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:51.589611 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:51.727766 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:51.734457 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:51.736229 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:51.737433 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bb55ba7b-d71c-42e6-8d43-6b98c6c9c5c5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.162095 Sep 19 17:32:51.737998 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 460/928] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:51 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:52.765370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:52.765943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:52.768393 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:52.773007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:52.773488 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:52.773920 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:52.774605 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:52.775055 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:52.776138 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:52.907722 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:52.916083 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:52.917514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:52.918678 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-44a12d43-0c8e-4639-afb4-265c41366d2f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.157521 Sep 19 17:32:52.919239 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 469/929] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:52 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:53.944215 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:53.944826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:53.947224 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:53.952212 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:53.952634 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:53.953093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:53.953828 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:53.954279 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:53.954698 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:53.970205 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:32:54.084189 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:54.092865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:54.094311 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:54.095491 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a40d02d-f8a5-45a3-aa17-5b53366e987e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.155349 Sep 19 17:32:54.096091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 461/930] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:53 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:55.121563 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:55.122171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:55.128631 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:55.129122 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:55.129559 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:55.130254 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:55.130713 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:55.131136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:55.258136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:55.266586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:55.268066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:55.269291 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-698542e0-c0bd-46f4-affb-6e3a8c2a658e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.152314 Sep 19 17:32:55.269857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 470/931] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:55 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:56.296568 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:56.297340 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:56.304110 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:56.304630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:56.305101 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:56.305857 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:56.306345 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:56.308212 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:56.439000 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:56.447049 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:56.448510 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:56.449680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29ac1131-cda5-4a27-8f5a-4623c9a17271 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.158102 Sep 19 17:32:56.450269 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 462/932] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:56 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:57.474635 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:57.475259 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:57.481724 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:57.482217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:57.482663 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:57.483363 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:57.483935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:57.484374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:57.609670 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:57.617837 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:57.619747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:57.620917 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-81028c23-c6f1-49f4-84f1-2d3dffe2205a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.150278 Sep 19 17:32:57.621486 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 471/933] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:57 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:58.646589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:58.647202 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:58.654246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:58.654727 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:58.655166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:58.655881 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:58.656340 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:58.656762 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:58.785807 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:58.793862 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:58.795330 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:58.796515 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3def2c4b-1871-4f42-98ba-4793dd20fb63 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.153826 Sep 19 17:32:58.797084 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 463/934] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:58 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:32:59.820801 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:32:59.821446 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:32:59.828181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:59.828667 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:59.829111 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:59.829812 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:32:59.830271 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:32:59.830734 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:32:59.957805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:59.966298 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:59.967764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:32:59.968941 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b4e1ec42-3915-4a68-974a-44976bab8de5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1743 microversion: 2.20 time: 0.152014 Sep 19 17:32:59.969508 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 472/935] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:32:59 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:33:00.995624 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:00.996250 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:01.002824 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:01.003305 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:01.003768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:01.004463 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:01.004914 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:01.005335 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:01.135722 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:01.144213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:01.145575 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:01.146742 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-554c7206-e3b3-4953-b5cd-dd8486fb5e99 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1743 microversion: 2.20 time: 0.155703 Sep 19 17:33:01.147337 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 464/936] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:00 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:01.457560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-afdfb340-8933-4d8c-b9d5-13b35f0e47f4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-251688986"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:33:01.458113 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-afdfb340-8933-4d8c-b9d5-13b35f0e47f4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:01.465042 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afdfb340-8933-4d8c-b9d5-13b35f0e47f4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:01.465529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afdfb340-8933-4d8c-b9d5-13b35f0e47f4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:01.465967 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afdfb340-8933-4d8c-b9d5-13b35f0e47f4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:01.466660 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afdfb340-8933-4d8c-b9d5-13b35f0e47f4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:01.467111 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afdfb340-8933-4d8c-b9d5-13b35f0e47f4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:01.467588 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afdfb340-8933-4d8c-b9d5-13b35f0e47f4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:01.605762 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.network.security_group_api [None req-afdfb340-8933-4d8c-b9d5-13b35f0e47f4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Removing security group b13baf59-e04a-4ef8-8152-e60be2d24070 from port 973c7f3d-c9c7-4b6e-bd83-8a6e87defccf Sep 19 17:33:01.973958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-afdfb340-8933-4d8c-b9d5-13b35f0e47f4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "POST /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/action" status: 202 len: 0 microversion: 2.1 time: 0.520303 Sep 19 17:33:01.974605 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 473/937] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Sep 19 17:33:01 2022] POST /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:33:01.983536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-4ea8f83f-966a-48a5-8c0d-6e46e7faff0e req-260a9ce6-a172-4a9b-81d5-288600e955fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "298f2df8-95dc-4ca2-b5d0-f798da2f2b7a", "tag": "973c7f3d-c9c7-4b6e-bd83-8a6e87defccf"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:33:02.002099 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4ea8f83f-966a-48a5-8c0d-6e46e7faff0e req-260a9ce6-a172-4a9b-81d5-288600e955fc service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:02.003302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4ea8f83f-966a-48a5-8c0d-6e46e7faff0e req-260a9ce6-a172-4a9b-81d5-288600e955fc service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:02.008794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4ea8f83f-966a-48a5-8c0d-6e46e7faff0e req-260a9ce6-a172-4a9b-81d5-288600e955fc service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:02.023615 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-4ea8f83f-966a-48a5-8c0d-6e46e7faff0e req-260a9ce6-a172-4a9b-81d5-288600e955fc service nova] Creating event network-changed:973c7f3d-c9c7-4b6e-bd83-8a6e87defccf for instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a on hv-cinder-84801 Sep 19 17:33:02.030427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-4ea8f83f-966a-48a5-8c0d-6e46e7faff0e req-260a9ce6-a172-4a9b-81d5-288600e955fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050519 Sep 19 17:33:02.031762 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 465/938] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:33:02.173962 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:02.174549 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:02.181597 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:02.182091 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:02.182719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:02.184026 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:02.184485 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:02.184909 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:02.389355 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:02.417023 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:02.418805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:02.420059 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-14caef0c-5be0-4ec4-a04a-05b31e759455 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1743 microversion: 2.20 time: 0.250910 Sep 19 17:33:02.426121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 474/939] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:02 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:03.222892 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cdffd032-aa70-42c8-9fa4-a34c94ed8c04 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:03.223597 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cdffd032-aa70-42c8-9fa4-a34c94ed8c04 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:03.224101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ec1a10a7-09b0-4639-baf9-0fbb4885f9fe req-f96b0cbf-3c5e-4fa9-8d30-fc8c27080630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "298f2df8-95dc-4ca2-b5d0-f798da2f2b7a", "tag": "973c7f3d-c9c7-4b6e-bd83-8a6e87defccf"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:33:03.230263 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdffd032-aa70-42c8-9fa4-a34c94ed8c04 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:03.230777 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdffd032-aa70-42c8-9fa4-a34c94ed8c04 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:03.231292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdffd032-aa70-42c8-9fa4-a34c94ed8c04 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:03.232232 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdffd032-aa70-42c8-9fa4-a34c94ed8c04 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:03.232754 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdffd032-aa70-42c8-9fa4-a34c94ed8c04 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:03.233344 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdffd032-aa70-42c8-9fa4-a34c94ed8c04 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:03.235120 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ec1a10a7-09b0-4639-baf9-0fbb4885f9fe req-f96b0cbf-3c5e-4fa9-8d30-fc8c27080630 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:03.235606 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ec1a10a7-09b0-4639-baf9-0fbb4885f9fe req-f96b0cbf-3c5e-4fa9-8d30-fc8c27080630 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:03.236079 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ec1a10a7-09b0-4639-baf9-0fbb4885f9fe req-f96b0cbf-3c5e-4fa9-8d30-fc8c27080630 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:03.249706 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ec1a10a7-09b0-4639-baf9-0fbb4885f9fe req-f96b0cbf-3c5e-4fa9-8d30-fc8c27080630 service nova] Creating event network-changed:973c7f3d-c9c7-4b6e-bd83-8a6e87defccf for instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a on hv-cinder-84801 Sep 19 17:33:03.255046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ec1a10a7-09b0-4639-baf9-0fbb4885f9fe req-f96b0cbf-3c5e-4fa9-8d30-fc8c27080630 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034534 Sep 19 17:33:03.255749 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 475/940] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:33:03.322048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-cdffd032-aa70-42c8-9fa4-a34c94ed8c04 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lazy-loading 'services' on Instance uuid 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:33:03.450893 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:03.452027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:03.458603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:03.459332 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:03.459996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:03.460710 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:03.461500 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:03.462152 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:03.561126 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cdffd032-aa70-42c8-9fa4-a34c94ed8c04 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "DELETE /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments/adeefcce-4da4-46d4-aac2-0e02e51b9311" status: 202 len: 0 microversion: 2.1 time: 0.342826 Sep 19 17:33:03.561995 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 466/941] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:33:03 2022] DELETE /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments/adeefcce-4da4-46d4-aac2-0e02e51b9311 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:33:03.576242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c145ef67-3d54-4a31-bc3a-4dba645bb09b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:03.579441 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c145ef67-3d54-4a31-bc3a-4dba645bb09b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:03.586598 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c145ef67-3d54-4a31-bc3a-4dba645bb09b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:03.587400 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c145ef67-3d54-4a31-bc3a-4dba645bb09b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:03.588034 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c145ef67-3d54-4a31-bc3a-4dba645bb09b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:03.589565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c145ef67-3d54-4a31-bc3a-4dba645bb09b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:03.595295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c145ef67-3d54-4a31-bc3a-4dba645bb09b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:03.595295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c145ef67-3d54-4a31-bc3a-4dba645bb09b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:03.629500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c145ef67-3d54-4a31-bc3a-4dba645bb09b tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061481 Sep 19 17:33:03.631352 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 467/942] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:33:03 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:33:03.671795 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f8b6bfc7-ed7c-47c6-8ec7-82b160fb20af req-c1aa53ef-54b4-438a-87ed-ebec8485a5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bea192-300a-4359-90a1-81ad16a35d10", "name": "network-vif-plugged", "status": "completed", "tag": "11cb86d3-62be-4d60-8b1e-e8a216766190"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:33:03.684383 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f8b6bfc7-ed7c-47c6-8ec7-82b160fb20af req-c1aa53ef-54b4-438a-87ed-ebec8485a5cc service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:03.684883 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f8b6bfc7-ed7c-47c6-8ec7-82b160fb20af req-c1aa53ef-54b4-438a-87ed-ebec8485a5cc service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:03.685295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f8b6bfc7-ed7c-47c6-8ec7-82b160fb20af req-c1aa53ef-54b4-438a-87ed-ebec8485a5cc service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:03.700425 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f8b6bfc7-ed7c-47c6-8ec7-82b160fb20af req-c1aa53ef-54b4-438a-87ed-ebec8485a5cc service nova] Creating event network-vif-plugged:11cb86d3-62be-4d60-8b1e-e8a216766190 for instance 70bea192-300a-4359-90a1-81ad16a35d10 on hv-cinder-84801 Sep 19 17:33:03.707783 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f8b6bfc7-ed7c-47c6-8ec7-82b160fb20af req-c1aa53ef-54b4-438a-87ed-ebec8485a5cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040681 Sep 19 17:33:03.709366 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 468/943] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:33:03.933693 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:03.944231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:03.945677 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:03.947066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b955b5b1-c33c-49c5-bf21-ad672eca1a0c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1743 microversion: 2.20 time: 0.500533 Sep 19 17:33:03.947755 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 476/944] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:03 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1743 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:33:04.647463 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b58e9ac-0d2c-46e2-b4f2-5793fb413956 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:04.649823 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1b58e9ac-0d2c-46e2-b4f2-5793fb413956 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:04.657325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b58e9ac-0d2c-46e2-b4f2-5793fb413956 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:04.657830 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b58e9ac-0d2c-46e2-b4f2-5793fb413956 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:04.658275 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b58e9ac-0d2c-46e2-b4f2-5793fb413956 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:04.659056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b58e9ac-0d2c-46e2-b4f2-5793fb413956 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:04.659524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b58e9ac-0d2c-46e2-b4f2-5793fb413956 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:04.659980 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b58e9ac-0d2c-46e2-b4f2-5793fb413956 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:04.690995 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1b58e9ac-0d2c-46e2-b4f2-5793fb413956 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051006 Sep 19 17:33:04.691499 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 469/945] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:33:04 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:33:04.974295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:04.974842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:04.981447 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:04.981938 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:04.984529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:04.984529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:04.984529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:04.984529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:04.988351 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:33:05.113630 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:05.122429 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:05.127019 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:05.127019 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-50b43877-d7db-4ed4-8ce8-ab275cb49ef6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1743 microversion: 2.20 time: 0.154891 Sep 19 17:33:05.127019 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 477/946] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:04 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:33:05.703801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3dfdd09-b596-458c-90f2-bb693fb70da9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:05.705904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e3dfdd09-b596-458c-90f2-bb693fb70da9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:05.712357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3dfdd09-b596-458c-90f2-bb693fb70da9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:05.712833 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3dfdd09-b596-458c-90f2-bb693fb70da9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:05.713268 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3dfdd09-b596-458c-90f2-bb693fb70da9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:05.713952 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3dfdd09-b596-458c-90f2-bb693fb70da9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:05.714404 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3dfdd09-b596-458c-90f2-bb693fb70da9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:05.714856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3dfdd09-b596-458c-90f2-bb693fb70da9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:05.743493 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e3dfdd09-b596-458c-90f2-bb693fb70da9 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044310 Sep 19 17:33:05.744082 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 470/947] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:33:05 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 17:33:05.755235 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:05.755763 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:05.761740 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:05.762223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:05.762668 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:05.763366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:05.763868 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:05.764560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:05.837559 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] HTTP exception thrown: Instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a is not attached to volume adeefcce-4da4-46d4-aac2-0e02e51b9311 Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Request method failure captured: Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments/adeefcce-4da4-46d4-aac2-0e02e51b9311 HTTP/1.1 Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKbsOtz8uSGgQal_A23sWIx5Gwe5uF9RG0ywVpF26bRuhXE2okASiEmjpE80I37GLfqsjKLgUX4uX6OUcUBNQ12KRyd0QhGzw79hyTIlBFzIQSoEKA4qmm-WFoysGy0aCyjieQUJvc7te4RGYG2icpKs7FlE_GN3GMhsP9sJenISRmU Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 751acab6697b47e59ee43cf30c937348 Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-TestMinimumBasicScenario-1734010511 Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:33:05.840008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:33:05.841728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_751acab6697b47e59ee43cf30c937348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/751acab6697b47e59ee43cf30c937348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/751acab6697b47e59ee43cf30c937348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/751acab6697b47e59ee43cf30c937348"}]}] Sep 19 17:33:05.841728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-TestMinimumBasicScenario-1734010511 Sep 19 17:33:05.841728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 751acab6697b47e59ee43cf30c937348 Sep 19 17:33:05.841728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1734010511 Sep 19 17:33:05.841728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-TestMinimumBasicScenario-1734010511-project Sep 19 17:33:05.841728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:33:05.841728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:33:05.841728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 7d02e6d4bc46456b8faf45e9532caeb1 Sep 19 17:33:05.841728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-TestMinimumBasicScenario-1734010511-project Sep 19 17:33:05.841728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:33:05.841728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a is not attached to volume adeefcce-4da4-46d4-aac2-0e02e51b9311 Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'server_id': '298f2df8-95dc-4ca2-b5d0-f798da2f2b7a', 'id': 'adeefcce-4da4-46d4-aac2-0e02e51b9311'} Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id adeefcce-4da4-46d4-aac2-0e02e51b9311. Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:33:05.842621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a is not attached to volume adeefcce-4da4-46d4-aac2-0e02e51b9311 Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a is not attached to volume adeefcce-4da4-46d4-aac2-0e02e51b9311 Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:33:05.844168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Returning 404 to user: Instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a is not attached to volume adeefcce-4da4-46d4-aac2-0e02e51b9311 {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:33:05.845286 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df9d7ab8-a75e-4bf9-95e8-4ccafefed87d tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "DELETE /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments/adeefcce-4da4-46d4-aac2-0e02e51b9311" status: 404 len: 154 microversion: 2.1 time: 0.090284 Sep 19 17:33:05.845286 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 478/948] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:33:05 2022] DELETE /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a/os-volume_attachments/adeefcce-4da4-46d4-aac2-0e02e51b9311 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:33:06.152891 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:06.153549 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:06.159438 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:06.160001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:06.160445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:06.161155 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:06.161670 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:06.162046 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:06.292585 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:06.301464 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:06.302908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:06.304116 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8b05609-8090-4088-876e-c3883d3ff25d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1743 microversion: 2.20 time: 0.156171 Sep 19 17:33:06.304687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 471/949] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:06 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:07.102101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-851ef869-61a6-4356-a9d7-d584f8d1ea84 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:07.102626 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-851ef869-61a6-4356-a9d7-d584f8d1ea84 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:07.108683 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-851ef869-61a6-4356-a9d7-d584f8d1ea84 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:07.109168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-851ef869-61a6-4356-a9d7-d584f8d1ea84 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:07.109602 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-851ef869-61a6-4356-a9d7-d584f8d1ea84 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:07.110299 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-851ef869-61a6-4356-a9d7-d584f8d1ea84 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:07.110756 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-851ef869-61a6-4356-a9d7-d584f8d1ea84 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:07.111185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-851ef869-61a6-4356-a9d7-d584f8d1ea84 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:07.138130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-851ef869-61a6-4356-a9d7-d584f8d1ea84 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:33:07.329358 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:07.330002 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:07.336603 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:07.337104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:07.337609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:07.338430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:07.338890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:07.339326 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:07.441803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-851ef869-61a6-4356-a9d7-d584f8d1ea84 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "DELETE /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 204 len: 0 microversion: 2.1 time: 0.343603 Sep 19 17:33:07.444497 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 479/950] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:33:07 2022] DELETE /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:33:07.453379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9cf9d030-48ce-44c2-918b-30fe5140d415 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:07.454076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9cf9d030-48ce-44c2-918b-30fe5140d415 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:07.460312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cf9d030-48ce-44c2-918b-30fe5140d415 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:07.460793 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cf9d030-48ce-44c2-918b-30fe5140d415 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:07.461257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cf9d030-48ce-44c2-918b-30fe5140d415 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:07.461981 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cf9d030-48ce-44c2-918b-30fe5140d415 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:07.462437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cf9d030-48ce-44c2-918b-30fe5140d415 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:07.462859 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cf9d030-48ce-44c2-918b-30fe5140d415 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:07.495047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:07.504311 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:07.505762 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:07.507021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-795caf6e-2b68-46b5-b93f-8cb3a8c0559f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.181718 Sep 19 17:33:07.507598 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 472/951] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:07 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:33:07.597989 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9cf9d030-48ce-44c2-918b-30fe5140d415 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:07.605777 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9cf9d030-48ce-44c2-918b-30fe5140d415 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1555 microversion: 2.1 time: 0.156722 Sep 19 17:33:07.606969 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 480/952] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:07 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:33:08.534667 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:08.535396 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:08.542205 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:08.542723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:08.543306 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:08.544672 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:08.545129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:08.545556 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:08.633734 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c4b7ecde-69e4-426f-a535-7c5a7c152b06 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:08.634430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c4b7ecde-69e4-426f-a535-7c5a7c152b06 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:08.646876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b7ecde-69e4-426f-a535-7c5a7c152b06 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:08.648123 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b7ecde-69e4-426f-a535-7c5a7c152b06 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:08.648842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b7ecde-69e4-426f-a535-7c5a7c152b06 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:08.649838 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b7ecde-69e4-426f-a535-7c5a7c152b06 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:08.650624 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b7ecde-69e4-426f-a535-7c5a7c152b06 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:08.651518 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b7ecde-69e4-426f-a535-7c5a7c152b06 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:08.714589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:08.723559 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:08.725332 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:08.726723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21c3d177-db50-41e3-b8f5-92f81fe7b278 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.196382 Sep 19 17:33:08.727510 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 473/953] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:08 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:33:08.805228 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c4b7ecde-69e4-426f-a535-7c5a7c152b06 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:08.815009 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c4b7ecde-69e4-426f-a535-7c5a7c152b06 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1555 microversion: 2.1 time: 0.187227 Sep 19 17:33:08.815785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 481/954] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:08 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:33:09.759489 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:09.760138 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:09.766892 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:09.767795 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:09.768630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:09.769232 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:09.769901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:09.770616 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:09.838806 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-00a05833-a308-4d89-bf2f-5626b4eece3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:09.840720 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-00a05833-a308-4d89-bf2f-5626b4eece3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:09.847941 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00a05833-a308-4d89-bf2f-5626b4eece3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:09.848775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00a05833-a308-4d89-bf2f-5626b4eece3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:09.849229 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00a05833-a308-4d89-bf2f-5626b4eece3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:09.849954 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00a05833-a308-4d89-bf2f-5626b4eece3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:09.850419 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00a05833-a308-4d89-bf2f-5626b4eece3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:09.850854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00a05833-a308-4d89-bf2f-5626b4eece3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:09.955644 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:09.966064 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:09.968071 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:09.969557 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-774fe355-3fa0-4cce-8ffc-c5540deff06a tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.214645 Sep 19 17:33:09.980200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 474/955] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:09 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:33:10.021488 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-00a05833-a308-4d89-bf2f-5626b4eece3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:10.029870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-00a05833-a308-4d89-bf2f-5626b4eece3f tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1555 microversion: 2.1 time: 0.195186 Sep 19 17:33:10.030816 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 482/956] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:09 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1555 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:33:10.865523 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3dd83078-2e05-4c53-88bb-d97ed2e17261 req-5dffeaef-2883-4a37-b376-e754f160338e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298f2df8-95dc-4ca2-b5d0-f798da2f2b7a", "name": "network-vif-deleted", "tag": "973c7f3d-c9c7-4b6e-bd83-8a6e87defccf"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:33:10.881730 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3dd83078-2e05-4c53-88bb-d97ed2e17261 req-5dffeaef-2883-4a37-b376-e754f160338e service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:10.882215 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3dd83078-2e05-4c53-88bb-d97ed2e17261 req-5dffeaef-2883-4a37-b376-e754f160338e service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:10.882656 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3dd83078-2e05-4c53-88bb-d97ed2e17261 req-5dffeaef-2883-4a37-b376-e754f160338e service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:10.894425 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3dd83078-2e05-4c53-88bb-d97ed2e17261 req-5dffeaef-2883-4a37-b376-e754f160338e service nova] Creating event network-vif-deleted:973c7f3d-c9c7-4b6e-bd83-8a6e87defccf for instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a on hv-cinder-84801 Sep 19 17:33:10.899595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3dd83078-2e05-4c53-88bb-d97ed2e17261 req-5dffeaef-2883-4a37-b376-e754f160338e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037879 Sep 19 17:33:10.900429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 475/957] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:33:10.996644 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:10.997281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:11.004112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:11.004623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:11.005145 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:11.005771 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:11.006547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:11.006681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:11.055182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-431c3d3b-6a94-4cfa-8845-11473ef057d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:11.056300 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-431c3d3b-6a94-4cfa-8845-11473ef057d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:11.065351 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431c3d3b-6a94-4cfa-8845-11473ef057d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:11.066902 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431c3d3b-6a94-4cfa-8845-11473ef057d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:11.067959 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431c3d3b-6a94-4cfa-8845-11473ef057d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:11.071429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431c3d3b-6a94-4cfa-8845-11473ef057d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:11.072554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431c3d3b-6a94-4cfa-8845-11473ef057d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:11.073896 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431c3d3b-6a94-4cfa-8845-11473ef057d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:11.182484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-431c3d3b-6a94-4cfa-8845-11473ef057d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:11.193020 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-431c3d3b-6a94-4cfa-8845-11473ef057d4 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1344 microversion: 2.1 time: 0.142868 Sep 19 17:33:11.193999 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 476/958] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:11 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1344 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:33:11.256417 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:11.256417 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:11.257577 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:11.259631 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e6c99037-3a06-402a-b1bd-7528ccb3c2db tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.266417 Sep 19 17:33:11.260681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 483/959] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:10 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:12.221110 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:12.240407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:12.270735 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:12.270735 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:12.270735 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:12.270735 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:12.271073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:12.271073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:12.288679 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:12.292055 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:12.300140 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:12.301625 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:12.302230 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:12.303554 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:12.304110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:12.304874 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:12.311528 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:12.312061 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:12.312505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:12.312959 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lazy-loading 'fault' on Instance uuid 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:33:12.359866 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02e6d4bc46456b8faf45e9532caeb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751acab6697b47e59ee43cf30c937348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:12.367675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ce7c05b-879b-407f-9929-1889cb6bd8a7 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 200 len: 1349 microversion: 2.1 time: 0.151299 Sep 19 17:33:12.377521 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 477/960] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:12 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 1349 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:33:12.489196 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:12.499628 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:12.502357 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:12.504618 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e19d688e-34ac-4cf9-b55e-57ee4c0cb42b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.219859 Sep 19 17:33:12.516866 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 484/961] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:12 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:33:13.392698 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:13.393313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] [instance: 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:13.399822 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:13.400314 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:13.400759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:13.401752 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:13.402211 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:13.402708 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:13.420090 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] HTTP exception thrown: Instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a could not be found. Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Request method failure captured: Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a HTTP/1.1 Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKbsOtz8uSGgQal_A23sWIx5Gwe5uF9RG0ywVpF26bRuhXE2okASiEmjpE80I37GLfqsjKLgUX4uX6OUcUBNQ12KRyd0QhGzw79hyTIlBFzIQSoEKA4qmm-WFoysGy0aCyjieQUJvc7te4RGYG2icpKs7FlE_GN3GMhsP9sJenISRmU Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 751acab6697b47e59ee43cf30c937348 Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-TestMinimumBasicScenario-1734010511 Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:33:13.421771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_751acab6697b47e59ee43cf30c937348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/751acab6697b47e59ee43cf30c937348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/751acab6697b47e59ee43cf30c937348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/751acab6697b47e59ee43cf30c937348"}]}] Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-TestMinimumBasicScenario-1734010511 Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 751acab6697b47e59ee43cf30c937348 Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1734010511 Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-TestMinimumBasicScenario-1734010511-project Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 7d02e6d4bc46456b8faf45e9532caeb1 Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-TestMinimumBasicScenario-1734010511-project Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a could not be found. Sep 19 17:33:13.423170 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '298f2df8-95dc-4ca2-b5d0-f798da2f2b7a'} Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a could not be found. Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:33:13.424238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a could not be found. Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a could not be found. Sep 19 17:33:13.425805 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:33:13.427586 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Returning 404 to user: Instance 298f2df8-95dc-4ca2-b5d0-f798da2f2b7a could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:33:13.427586 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8a875c80-b892-442a-8b90-1bd46edd89b0 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a" status: 404 len: 111 microversion: 2.1 time: 0.035001 Sep 19 17:33:13.427586 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 478/962] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:13 2022] GET /compute/v2.1/servers/298f2df8-95dc-4ca2-b5d0-f798da2f2b7a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:33:13.432972 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-07b04890-9e2c-41f4-b4cf-adba23c0b9d5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] Calling method '.version_select at 0x7fd4d5f0fee0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:13.499360 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-07b04890-9e2c-41f4-b4cf-adba23c0b9d5 tempest-TestMinimumBasicScenario-1734010511 tempest-TestMinimumBasicScenario-1734010511-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1857113161" status: 202 len: 0 microversion: 2.1 time: 0.070573 Sep 19 17:33:13.500049 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 485/963] 10.222.0.61 () {58 vars in 1272 bytes} [Mon Sep 19 17:33:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1857113161 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:33:13.534522 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:13.535143 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:13.541609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:13.542103 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:13.542914 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:13.544174 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:13.544632 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:13.545060 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:13.724485 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:13.726946 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:33:13.734748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:13.738596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:13.738596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc901a47-3af3-4715-8507-14941b7a07af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.207628 Sep 19 17:33:13.738596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 479/964] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:13 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:33:14.770074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:14.770738 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:14.779486 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:14.780114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:14.780564 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:14.781685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:14.782328 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:14.782766 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:14.936714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:14.957941 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:14.959419 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:14.969321 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4d01f5cb-425d-4d03-b7fb-633932ec46a4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.203207 Sep 19 17:33:14.970173 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 486/965] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:14 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:16.011612 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:16.012943 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:16.021029 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:16.021522 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:16.021951 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:16.022846 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:16.023588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:16.024314 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:16.167221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:16.177731 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:16.179266 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:16.180533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-787c4ea7-e42d-4d67-b2d7-94a3e8a6cf30 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.172857 Sep 19 17:33:16.181166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 480/966] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:16 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:17.213737 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:17.225656 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:17.261007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:17.261917 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:17.262585 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:17.263672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:17.264497 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:17.265029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:17.572102 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:17.584251 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:17.586034 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:17.587620 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4455b1c2-d1ac-4795-bd2f-fd9716da07c7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.380841 Sep 19 17:33:17.588740 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 487/967] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:17 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:18.616411 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:18.617709 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:18.629165 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:18.633270 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:18.633967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:18.635824 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:18.638078 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:18.643262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:18.832668 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:18.843826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:18.845544 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:18.846961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-817a2627-ecf4-4db2-abfb-18574d9c628f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.234573 Sep 19 17:33:18.868400 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 481/968] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:18 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:19.875892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:19.876495 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:19.882819 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:19.883297 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:19.883826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:19.884522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:19.884990 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:19.885394 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:20.114559 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:20.133298 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:20.135170 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:20.136475 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-85bce01a-0e3c-4e1a-8754-adc888e155de tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.264559 Sep 19 17:33:20.138090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 488/969] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:19 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:21.169714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:21.169714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:21.175410 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:21.176444 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:21.177122 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:21.178066 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:21.178737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:21.179437 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:21.389620 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:21.400267 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:21.402556 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:21.404390 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-00918d9f-e3e0-429a-8145-5ab7556d96ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1738 microversion: 2.20 time: 0.240956 Sep 19 17:33:21.411272 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 482/970] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:21 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:22.651242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:22.652853 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:22.659430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:22.660046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:22.660552 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:22.661673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:22.662357 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:22.663031 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:23.147446 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:23.160678 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:23.162505 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:23.163900 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-66b2e87c-8917-4cf3-9e69-b84ab3477ea4 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1720 microversion: 2.20 time: 0.736880 Sep 19 17:33:23.164875 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 489/971] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:22 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1720 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:23.937275 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-26af6053-955a-4410-993a-71a44e371985 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:23.938554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-26af6053-955a-4410-993a-71a44e371985 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:23.941107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6385743c-caf1-4d72-b083-76f4bbdd0dc9 req-2677e232-b39f-4840-90e0-faba42231f81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9442149d-db6c-4fd9-b92a-3eaf3e8c2046", "tag": "ddae7d4a-71c6-4777-a374-39594620566f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:33:23.946872 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26af6053-955a-4410-993a-71a44e371985 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:23.948234 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26af6053-955a-4410-993a-71a44e371985 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:23.948974 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26af6053-955a-4410-993a-71a44e371985 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:23.950167 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:33:23.951043 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26af6053-955a-4410-993a-71a44e371985 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:23.951731 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26af6053-955a-4410-993a-71a44e371985 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:23.952692 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26af6053-955a-4410-993a-71a44e371985 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:23.954319 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6385743c-caf1-4d72-b083-76f4bbdd0dc9 req-2677e232-b39f-4840-90e0-faba42231f81 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:23.954848 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6385743c-caf1-4d72-b083-76f4bbdd0dc9 req-2677e232-b39f-4840-90e0-faba42231f81 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:23.955607 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6385743c-caf1-4d72-b083-76f4bbdd0dc9 req-2677e232-b39f-4840-90e0-faba42231f81 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:23.985147 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-26af6053-955a-4410-993a-71a44e371985 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:33:23.988548 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6385743c-caf1-4d72-b083-76f4bbdd0dc9 req-2677e232-b39f-4840-90e0-faba42231f81 service nova] Creating event network-changed:ddae7d4a-71c6-4777-a374-39594620566f for instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 on hv-cinder-84801 Sep 19 17:33:24.000769 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6385743c-caf1-4d72-b083-76f4bbdd0dc9 req-2677e232-b39f-4840-90e0-faba42231f81 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063010 Sep 19 17:33:24.007843 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 490/972] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:33:24.192269 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:24.192269 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:24.199600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:24.200127 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:24.200730 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:24.201514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:24.202057 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:24.202685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:24.363835 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:24.372709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:24.375260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:24.376557 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c00b1924-cd48-4ede-b94b-acb950690df2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1720 microversion: 2.20 time: 0.189812 Sep 19 17:33:24.384173 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 491/973] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:24 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:33:24.385038 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-26af6053-955a-4410-993a-71a44e371985 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 204 len: 0 microversion: 2.1 time: 0.453223 Sep 19 17:33:24.386067 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 483/974] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:33:23 2022] DELETE /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:33:24.397554 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6692cacb-17d2-4795-9191-007905ce7355 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:24.398314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6692cacb-17d2-4795-9191-007905ce7355 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:24.405726 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6692cacb-17d2-4795-9191-007905ce7355 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:24.406223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6692cacb-17d2-4795-9191-007905ce7355 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:24.406667 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6692cacb-17d2-4795-9191-007905ce7355 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:24.407377 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6692cacb-17d2-4795-9191-007905ce7355 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:24.407877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6692cacb-17d2-4795-9191-007905ce7355 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:24.408314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6692cacb-17d2-4795-9191-007905ce7355 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:24.567938 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6692cacb-17d2-4795-9191-007905ce7355 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:24.577142 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6692cacb-17d2-4795-9191-007905ce7355 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.183449 Sep 19 17:33:24.577794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 492/975] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:24 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:33:25.403416 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:25.404300 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:25.411837 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:25.412346 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:25.412794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:25.413526 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:25.413990 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:25.414426 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:25.556359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-543d63aa-df18-4156-84e9-f9769a8de102 req-13dfaada-c9e4-4ad2-8a7a-a3ef1fc59908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bea192-300a-4359-90a1-81ad16a35d10", "name": "network-vif-unplugged", "status": "completed", "tag": "11cb86d3-62be-4d60-8b1e-e8a216766190"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:33:25.569749 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-543d63aa-df18-4156-84e9-f9769a8de102 req-13dfaada-c9e4-4ad2-8a7a-a3ef1fc59908 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:25.570342 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-543d63aa-df18-4156-84e9-f9769a8de102 req-13dfaada-c9e4-4ad2-8a7a-a3ef1fc59908 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:25.570852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-543d63aa-df18-4156-84e9-f9769a8de102 req-13dfaada-c9e4-4ad2-8a7a-a3ef1fc59908 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:25.573584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:25.583755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:25.584534 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-543d63aa-df18-4156-84e9-f9769a8de102 req-13dfaada-c9e4-4ad2-8a7a-a3ef1fc59908 service nova] Creating event network-vif-unplugged:11cb86d3-62be-4d60-8b1e-e8a216766190 for instance 70bea192-300a-4359-90a1-81ad16a35d10 on hv-cinder-84801 Sep 19 17:33:25.585368 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:25.586857 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c1f829f2-3f7d-4d2c-9247-611e57b910b1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1720 microversion: 2.20 time: 0.187941 Sep 19 17:33:25.597035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 484/976] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:25 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:25.598488 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-543d63aa-df18-4156-84e9-f9769a8de102 req-13dfaada-c9e4-4ad2-8a7a-a3ef1fc59908 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050648 Sep 19 17:33:25.602711 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 493/977] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:33:25.607907 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1517b92-0d75-414c-91ce-a4528c5efc88 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:25.608543 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1517b92-0d75-414c-91ce-a4528c5efc88 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:25.620533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1517b92-0d75-414c-91ce-a4528c5efc88 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:25.621339 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1517b92-0d75-414c-91ce-a4528c5efc88 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:25.621779 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1517b92-0d75-414c-91ce-a4528c5efc88 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:25.622509 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1517b92-0d75-414c-91ce-a4528c5efc88 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:25.622967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1517b92-0d75-414c-91ce-a4528c5efc88 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:25.623399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1517b92-0d75-414c-91ce-a4528c5efc88 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:25.816767 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1517b92-0d75-414c-91ce-a4528c5efc88 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:25.825540 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1517b92-0d75-414c-91ce-a4528c5efc88 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.227331 Sep 19 17:33:25.826702 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 485/978] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:25 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:33:26.627465 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:26.628112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:26.634170 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:26.634645 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:26.635079 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:26.635850 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:26.636310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:26.637378 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:26.656054 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:33:26.768495 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:26.776680 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:26.778182 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:26.779401 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-13cc41cf-2b83-4c50-8ef0-62efe46392cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1720 microversion: 2.20 time: 0.156788 Sep 19 17:33:26.780001 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 494/979] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:26 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:26.850624 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f1ee881-6737-4198-bbf2-d577f3d616da tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:26.851268 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6f1ee881-6737-4198-bbf2-d577f3d616da tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:26.853791 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:33:26.859075 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1ee881-6737-4198-bbf2-d577f3d616da tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:26.859581 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1ee881-6737-4198-bbf2-d577f3d616da tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:26.860036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1ee881-6737-4198-bbf2-d577f3d616da tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:26.860745 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1ee881-6737-4198-bbf2-d577f3d616da tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:26.861202 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1ee881-6737-4198-bbf2-d577f3d616da tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:26.861633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1ee881-6737-4198-bbf2-d577f3d616da tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:26.998525 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6f1ee881-6737-4198-bbf2-d577f3d616da tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:27.006554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f1ee881-6737-4198-bbf2-d577f3d616da tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.159820 Sep 19 17:33:27.007137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 486/980] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:26 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:33:27.805215 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:27.806089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:27.813767 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:27.814454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:27.815071 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:27.816942 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:27.817559 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:27.818148 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:27.994225 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:28.002714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:28.004243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:28.008847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-799f84c0-e30e-4db1-9d28-3000cebf15a5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1723 microversion: 2.20 time: 0.204438 Sep 19 17:33:28.008847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 495/981] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:27 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:28.030701 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19a33d77-a83a-4910-9f02-f0f2da0407d5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:28.031530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-19a33d77-a83a-4910-9f02-f0f2da0407d5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:28.031841 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3932e5e-b0bc-4d3d-b48f-86aa75661be8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e2a09e1-502a-43b7-80af-c4395901310f"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:33:28.034485 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e3932e5e-b0bc-4d3d-b48f-86aa75661be8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:28.038684 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19a33d77-a83a-4910-9f02-f0f2da0407d5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:28.039545 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19a33d77-a83a-4910-9f02-f0f2da0407d5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:28.039545 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19a33d77-a83a-4910-9f02-f0f2da0407d5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:28.040200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19a33d77-a83a-4910-9f02-f0f2da0407d5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:28.040322 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3932e5e-b0bc-4d3d-b48f-86aa75661be8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:28.040648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19a33d77-a83a-4910-9f02-f0f2da0407d5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:28.040763 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3932e5e-b0bc-4d3d-b48f-86aa75661be8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:28.041070 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19a33d77-a83a-4910-9f02-f0f2da0407d5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:28.041209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3932e5e-b0bc-4d3d-b48f-86aa75661be8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:28.043374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3932e5e-b0bc-4d3d-b48f-86aa75661be8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:28.043374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3932e5e-b0bc-4d3d-b48f-86aa75661be8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:28.043374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3932e5e-b0bc-4d3d-b48f-86aa75661be8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:28.185371 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-19a33d77-a83a-4910-9f02-f0f2da0407d5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:28.194772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19a33d77-a83a-4910-9f02-f0f2da0407d5 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1569 microversion: 2.1 time: 0.168094 Sep 19 17:33:28.195447 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 487/982] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:28 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:33:28.739572 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d67b006f-001e-4452-8deb-da7bb8f5801f req-3d908d4b-949c-499f-a888-c751c071b9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9442149d-db6c-4fd9-b92a-3eaf3e8c2046", "name": "network-vif-deleted", "tag": "ddae7d4a-71c6-4777-a374-39594620566f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:33:28.749898 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d67b006f-001e-4452-8deb-da7bb8f5801f req-3d908d4b-949c-499f-a888-c751c071b9e8 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:28.750382 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d67b006f-001e-4452-8deb-da7bb8f5801f req-3d908d4b-949c-499f-a888-c751c071b9e8 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:28.750816 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d67b006f-001e-4452-8deb-da7bb8f5801f req-3d908d4b-949c-499f-a888-c751c071b9e8 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:28.762695 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d67b006f-001e-4452-8deb-da7bb8f5801f req-3d908d4b-949c-499f-a888-c751c071b9e8 service nova] Creating event network-vif-deleted:ddae7d4a-71c6-4777-a374-39594620566f for instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 on hv-cinder-84801 Sep 19 17:33:28.768013 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d67b006f-001e-4452-8deb-da7bb8f5801f req-3d908d4b-949c-499f-a888-c751c071b9e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032398 Sep 19 17:33:28.768873 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 488/983] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:33:29.219676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-528bf7cc-71e4-468d-a297-1b082ef23cc8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:29.223165 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-528bf7cc-71e4-468d-a297-1b082ef23cc8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:29.226759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-528bf7cc-71e4-468d-a297-1b082ef23cc8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:29.227291 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-528bf7cc-71e4-468d-a297-1b082ef23cc8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:29.227750 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-528bf7cc-71e4-468d-a297-1b082ef23cc8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:29.228453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-528bf7cc-71e4-468d-a297-1b082ef23cc8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:29.228919 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-528bf7cc-71e4-468d-a297-1b082ef23cc8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:29.229351 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-528bf7cc-71e4-468d-a297-1b082ef23cc8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:29.229748 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e3932e5e-b0bc-4d3d-b48f-86aa75661be8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "POST /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.202448 Sep 19 17:33:29.231077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 496/984] 10.222.0.61 () {62 vars in 1364 bytes} [Mon Sep 19 17:33:28 2022] POST /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/os-volume_attachments => generated 188 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 17:33:29.307560 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-528bf7cc-71e4-468d-a297-1b082ef23cc8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:29.316223 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-528bf7cc-71e4-468d-a297-1b082ef23cc8 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1219 microversion: 2.1 time: 0.101446 Sep 19 17:33:29.317009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 489/985] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:29 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:33:29.371146 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17f87a10-25c7-46f4-a2f2-6e6f14b9b741 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:29.371643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-17f87a10-25c7-46f4-a2f2-6e6f14b9b741 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:29.377682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f87a10-25c7-46f4-a2f2-6e6f14b9b741 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:29.378169 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f87a10-25c7-46f4-a2f2-6e6f14b9b741 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:29.378601 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f87a10-25c7-46f4-a2f2-6e6f14b9b741 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:29.379289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f87a10-25c7-46f4-a2f2-6e6f14b9b741 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:29.379790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f87a10-25c7-46f4-a2f2-6e6f14b9b741 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:29.380220 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f87a10-25c7-46f4-a2f2-6e6f14b9b741 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:30.030571 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-17f87a10-25c7-46f4-a2f2-6e6f14b9b741 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "DELETE /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/os-volume_attachments/7e2a09e1-502a-43b7-80af-c4395901310f" status: 202 len: 0 microversion: 2.20 time: 0.663161 Sep 19 17:33:30.031660 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 497/986] 10.222.0.61 () {60 vars in 1457 bytes} [Mon Sep 19 17:33:29 2022] DELETE /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/os-volume_attachments/7e2a09e1-502a-43b7-80af-c4395901310f => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:33:30.099163 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42d329cc-177b-4cf4-a226-454de5eabbd6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:33:30.099867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42d329cc-177b-4cf4-a226-454de5eabbd6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:30.106032 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42d329cc-177b-4cf4-a226-454de5eabbd6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:30.106549 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42d329cc-177b-4cf4-a226-454de5eabbd6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:30.107039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42d329cc-177b-4cf4-a226-454de5eabbd6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:30.107997 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42d329cc-177b-4cf4-a226-454de5eabbd6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:30.108546 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42d329cc-177b-4cf4-a226-454de5eabbd6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:30.108976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42d329cc-177b-4cf4-a226-454de5eabbd6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:30.153865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42d329cc-177b-4cf4-a226-454de5eabbd6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121134) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 17:33:30.338459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:30.339068 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:30.345051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:30.346580 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:30.346580 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:30.347101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:30.347226 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:30.347592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:30.380432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:30.380923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:30.381393 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:30.381898 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lazy-loading 'fault' on Instance uuid 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:33:30.424138 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038341fa1ec446e080145a30f1911a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff66ee28420498aa3f3ac65946c8bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:30.432200 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c5faa0af-ca43-4b02-b373-dbba83346806 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 200 len: 1224 microversion: 2.1 time: 0.097578 Sep 19 17:33:30.432777 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 498/987] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:30 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:33:30.501729 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42d329cc-177b-4cf4-a226-454de5eabbd6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "POST /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/action" status: 202 len: 0 microversion: 2.20 time: 0.406307 Sep 19 17:33:30.502667 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 490/988] 10.222.0.61 () {62 vars in 1319 bytes} [Mon Sep 19 17:33:30 2022] POST /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:33:30.510543 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:30.511129 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:30.519119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:30.519119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:30.519119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:30.519376 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:30.519649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:30.520108 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:30.655185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:30.663479 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:30.664937 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:30.666103 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d0ff6ac-92ac-441d-8b5b-4649c050b52f tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1671 microversion: 2.20 time: 0.159576 Sep 19 17:33:30.666659 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 499/989] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:30 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:31.455734 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:31.456357 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] [instance: 9442149d-db6c-4fd9-b92a-3eaf3e8c2046] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:31.462889 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:31.463364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:31.463827 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:31.465144 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:31.465604 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:31.466028 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:31.480672 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] HTTP exception thrown: Instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 could not be found. Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Request method failure captured: Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 HTTP/1.1 Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKZ02fNpo_YbQOXHqs54Pu7lcxSXL1_WLWX4BOeExft2oUlmrOdF2XjVagY3pmyNjlRUbkgLmAc3mM5RkWwoh4V3MugArBkELlChwir2vi-6mQgKF-hRu7HVBjyu-x3jOTabqbchfe9ffpkcBf0eJVgaT3op1LrEY1_1P_bKhcfofrQ Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 4ff66ee28420498aa3f3ac65946c8bca Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-TestShelveInstance-960465530 Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:33:31.482607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4ff66ee28420498aa3f3ac65946c8bca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4ff66ee28420498aa3f3ac65946c8bca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4ff66ee28420498aa3f3ac65946c8bca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4ff66ee28420498aa3f3ac65946c8bca"}]}] Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-TestShelveInstance-960465530 Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 4ff66ee28420498aa3f3ac65946c8bca Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestShelveInstance-960465530 Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-TestShelveInstance-960465530-project Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 038341fa1ec446e080145a30f1911a3b Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-TestShelveInstance-960465530-project Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 could not be found. Sep 19 17:33:31.484468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '9442149d-db6c-4fd9-b92a-3eaf3e8c2046'} Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 could not be found. Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:33:31.485281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 could not be found. Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 could not be found. Sep 19 17:33:31.487152 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:33:31.488723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Returning 404 to user: Instance 9442149d-db6c-4fd9-b92a-3eaf3e8c2046 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:33:31.488723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca238add-68ca-47d5-9dd3-40ea9df18ea6 tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046" status: 404 len: 111 microversion: 2.1 time: 0.032385 Sep 19 17:33:31.488723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 491/990] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:33:31 2022] GET /compute/v2.1/servers/9442149d-db6c-4fd9-b92a-3eaf3e8c2046 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:33:31.692863 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:31.693414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:31.701252 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:31.701786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:31.702275 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:31.702978 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:31.703433 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:31.706230 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:31.739659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-956e1e86-edd0-4a5a-bc4a-6f2f3b7307dd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] Calling method '.version_select at 0x7fd4d60a7e50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:31.846527 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-956e1e86-edd0-4a5a-bc4a-6f2f3b7307dd tempest-TestShelveInstance-960465530 tempest-TestShelveInstance-960465530-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-564527321" status: 202 len: 0 microversion: 2.1 time: 0.111529 Sep 19 17:33:31.847294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 492/991] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Sep 19 17:33:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-564527321 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:33:31.848675 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:31.858099 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:31.859540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:31.860747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3a4bdd14-21f3-480c-b566-182fd894f1cb tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1673 microversion: 2.20 time: 0.172153 Sep 19 17:33:31.861329 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 500/992] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:31 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:32.887395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:32.888156 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:32.896077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:32.896626 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:32.897242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:32.897702 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:32.898294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:32.898809 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:33.066514 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:33.078560 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:33.080449 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:33.081646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0362ea1d-de73-46e9-b33c-f2a3aa4cb4af tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.198690 Sep 19 17:33:33.097353 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 493/993] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:32 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:33:34.111620 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:34.113013 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:34.123514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:34.127432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:34.128139 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:34.130987 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:34.132021 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:34.135634 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:34.425188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:34.438044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:34.439496 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:34.449036 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9ee62579-35b7-4e88-82a8-9015a8f8de49 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.343498 Sep 19 17:33:34.449642 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 501/994] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:34 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:35.485184 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:35.487601 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:35.502772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:35.504600 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:35.506492 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:35.508240 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:35.508917 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:35.510622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:35.769727 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:35.783957 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:35.786833 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:35.790539 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-18005c51-6234-4acd-8723-cb5fc63b860c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.317329 Sep 19 17:33:35.791631 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 494/995] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:35 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:36.818814 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:36.819684 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:36.826580 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:36.827171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:36.827854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:36.828588 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:36.829085 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:36.829557 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:36.996127 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:37.008208 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:37.009723 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:37.013101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5cab4f2b-4e02-4438-a9ac-ca8b3ff1e7c1 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.196877 Sep 19 17:33:37.013101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 502/996] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:36 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:38.037786 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:38.038466 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:38.049998 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:38.051346 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:38.051346 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:38.052964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:38.052964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:38.052964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:38.236334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:38.267158 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:38.267158 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:38.267158 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-33d5a35f-a0ba-4039-bb03-b2b21a03ab39 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.216031 Sep 19 17:33:38.267771 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 495/997] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:38 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:39.274550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:39.275189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:39.282728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:39.283119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:39.283836 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:39.284786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:39.285445 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:39.286039 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:39.594752 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:39.603181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:39.604629 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:39.605887 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4fa3aeb9-d724-4d86-acb9-10528660fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.335406 Sep 19 17:33:39.606457 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 503/998] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:39 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:40.632960 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:40.633687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:40.653813 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:40.654309 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:40.654741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:40.655642 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:40.656505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:40.657091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:40.696232 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:33:40.918367 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:40.943128 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:40.946686 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:40.949048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-078bbdff-8409-45ab-a8ca-2c1e87d4a774 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.320314 Sep 19 17:33:40.949854 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 496/999] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:40 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:41.976212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:41.976912 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:41.983842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:41.984904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:41.984904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:41.985778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:41.986248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:41.986673 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:42.154599 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:42.165107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:42.166431 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:42.167724 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b31a1fb7-1a37-48a8-8f01-64a9d9c79f3e tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.195948 Sep 19 17:33:42.168710 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 504/1000] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:41 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:43.195973 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:43.196620 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:43.203164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:43.203658 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:43.204132 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:43.204843 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:43.205302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:43.205733 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:43.407763 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:43.418819 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:43.420397 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:43.421646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c55e62b1-63ad-42d5-a5dc-356fe3b0fbc7 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.230610 Sep 19 17:33:43.422223 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 497/1001] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:43 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:44.448267 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:44.449471 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:44.456036 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:44.456527 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:44.456970 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:44.457675 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:44.458134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:44.458566 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:44.836889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:44.839074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:33:44.845771 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:44.856952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:44.856952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a589b9b0-1d60-470f-ae07-d93c4d48c6e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.404093 Sep 19 17:33:44.856952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 505/1002] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:44 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:45.874308 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:45.874944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:45.881525 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:45.882002 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:45.882435 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:45.883120 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:45.883567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:45.884020 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:46.019053 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:46.020768 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:46.022295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:46.023468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d8ee432d-4b65-493d-848a-e4f31b8601ae tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.153712 Sep 19 17:33:46.024065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 498/1003] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:45 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:47.048579 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:47.049190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:47.056380 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:47.056867 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:47.057305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:47.058108 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:47.058569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:47.058997 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:47.189295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:47.197364 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:47.199298 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:47.200486 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bdd53a99-2537-4364-87a6-dc32ee1e0da5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.155988 Sep 19 17:33:47.201050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 506/1004] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:47 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:48.226459 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:48.227098 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:48.234273 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:48.234774 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:48.235318 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:48.236129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:48.236587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:48.237017 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:48.365346 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:48.373607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:48.375018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:48.376223 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d2b656bf-dcd3-4369-af60-98196e006d90 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.153879 Sep 19 17:33:48.376811 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 499/1005] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:48 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:49.402470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:49.403756 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:49.410957 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:49.411440 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:49.411918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:49.412626 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:49.413087 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:49.413520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:49.541891 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:49.550317 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:49.551791 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:49.553047 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99665e2b-b2e1-4b1a-a80b-977094aea84d tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.154401 Sep 19 17:33:49.553672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 507/1006] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:49 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:50.578888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:50.579440 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:50.585565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:50.586049 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:50.586486 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:50.587177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:50.587631 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:50.588091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:50.721409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:50.729783 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:50.731284 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:50.732493 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f083fab0-db6a-4487-9e51-e27f40941e00 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.157660 Sep 19 17:33:50.733194 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 500/1007] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:50 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:51.759020 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:51.759736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:51.766803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:51.767301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:51.767781 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:51.768613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:51.769086 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:51.769577 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:51.912621 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:51.921525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:51.923069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:51.924282 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0e046d69-2acf-408e-a65b-33bc2160f389 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.169563 Sep 19 17:33:51.925195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 508/1008] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:51 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:52.950345 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:52.951068 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:52.957704 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:52.958191 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:52.958630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:52.959361 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:52.959850 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:52.960280 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:53.095559 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:53.103818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:53.105298 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:53.106479 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1dea6a10-b77c-4b83-894a-d10022569546 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.160625 Sep 19 17:33:53.107057 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 501/1009] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:52 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:53.632729 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-031f5bf6-a9dc-4a40-b6bd-3789009b307a req-99908a94-afb3-48d5-9547-6446fe36802d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bea192-300a-4359-90a1-81ad16a35d10", "name": "network-vif-plugged", "status": "completed", "tag": "11cb86d3-62be-4d60-8b1e-e8a216766190"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:33:53.643863 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-031f5bf6-a9dc-4a40-b6bd-3789009b307a req-99908a94-afb3-48d5-9547-6446fe36802d service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:53.644341 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-031f5bf6-a9dc-4a40-b6bd-3789009b307a req-99908a94-afb3-48d5-9547-6446fe36802d service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:53.644804 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-031f5bf6-a9dc-4a40-b6bd-3789009b307a req-99908a94-afb3-48d5-9547-6446fe36802d service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:53.655589 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-031f5bf6-a9dc-4a40-b6bd-3789009b307a req-99908a94-afb3-48d5-9547-6446fe36802d service nova] Creating event network-vif-plugged:11cb86d3-62be-4d60-8b1e-e8a216766190 for instance 70bea192-300a-4359-90a1-81ad16a35d10 on hv-cinder-84801 Sep 19 17:33:53.660800 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-031f5bf6-a9dc-4a40-b6bd-3789009b307a req-99908a94-afb3-48d5-9547-6446fe36802d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031775 Sep 19 17:33:53.661388 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 509/1010] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:33:54.131807 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:54.132416 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:54.139388 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:54.139902 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:54.140335 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:54.141125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:54.141574 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:54.141990 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:54.277128 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:54.285844 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:54.287286 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:54.288486 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-69204ab3-da18-4b60-b1f4-15363bf7e4bd tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.160695 Sep 19 17:33:54.289049 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 502/1011] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:54 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:55.314587 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:55.315281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:55.317758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=42 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:33:55.322612 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:55.323095 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:55.323534 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:55.324286 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:55.324744 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:55.325672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:55.461999 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:55.470681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:55.472156 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:55.473316 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-40c06d89-b2bd-489c-be41-8d56ef5b985b tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.163055 Sep 19 17:33:55.473904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 510/1012] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:55 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:56.498481 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:56.504798 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:56.505993 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:56.506482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:56.506945 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:56.507648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:56.508154 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:56.508584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:56.639317 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:56.647588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:56.649090 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:56.650271 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-99b69c92-42d0-4f47-ba3c-1ccf836394e8 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1729 microversion: 2.20 time: 0.155822 Sep 19 17:33:56.663835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 503/1013] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:56 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:33:57.677411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:33:57.678029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:33:57.684503 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:57.685033 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:57.685436 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:57.686141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:33:57.686601 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:33:57.687030 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:33:57.816891 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:57.825054 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:57.827265 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:33:57.828484 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09a81aeb-ba85-4f5d-bff7-7a75d878fc5c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1716 microversion: 2.20 time: 0.155006 Sep 19 17:33:57.829050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 511/1014] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:33:57 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:34:15.507191 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f49dffab-adda-4dd3-89a1-580cebc406c1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:15.507828 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f49dffab-adda-4dd3-89a1-580cebc406c1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:15.510293 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:15.510962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=47 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:15.516005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f49dffab-adda-4dd3-89a1-580cebc406c1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:15.516528 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f49dffab-adda-4dd3-89a1-580cebc406c1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:15.516980 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f49dffab-adda-4dd3-89a1-580cebc406c1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:15.517711 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f49dffab-adda-4dd3-89a1-580cebc406c1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:15.518242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f49dffab-adda-4dd3-89a1-580cebc406c1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:15.518675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f49dffab-adda-4dd3-89a1-580cebc406c1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:15.542102 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f49dffab-adda-4dd3-89a1-580cebc406c1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/ips" status: 200 len: 148 microversion: 2.1 time: 0.038928 Sep 19 17:34:15.542697 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 504/1015] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Sep 19 17:34:15 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:18.359873 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f75c21e3-19bf-4ce7-97c0-84737a615d10 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a520123-d4d7-4bf7-a602-2061fd778e2c"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:34:18.362723 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f75c21e3-19bf-4ce7-97c0-84737a615d10 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:18.364945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:18.365702 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=33 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:18.370755 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75c21e3-19bf-4ce7-97c0-84737a615d10 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:18.371247 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75c21e3-19bf-4ce7-97c0-84737a615d10 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:18.371711 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75c21e3-19bf-4ce7-97c0-84737a615d10 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:18.372431 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75c21e3-19bf-4ce7-97c0-84737a615d10 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:18.372894 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75c21e3-19bf-4ce7-97c0-84737a615d10 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:18.373327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75c21e3-19bf-4ce7-97c0-84737a615d10 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:19.100828 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f75c21e3-19bf-4ce7-97c0-84737a615d10 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745093 Sep 19 17:34:19.101512 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 512/1016] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:34:18 2022] POST /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:19.962722 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24483cc3-2525-4f06-9782-5ec98e5d8d1e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:19.963302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-24483cc3-2525-4f06-9782-5ec98e5d8d1e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:19.969985 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24483cc3-2525-4f06-9782-5ec98e5d8d1e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:19.970465 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24483cc3-2525-4f06-9782-5ec98e5d8d1e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:19.973115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24483cc3-2525-4f06-9782-5ec98e5d8d1e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:19.973115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24483cc3-2525-4f06-9782-5ec98e5d8d1e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:19.973115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24483cc3-2525-4f06-9782-5ec98e5d8d1e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:19.973115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24483cc3-2525-4f06-9782-5ec98e5d8d1e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:19.997340 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-24483cc3-2525-4f06-9782-5ec98e5d8d1e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/ips" status: 200 len: 145 microversion: 2.1 time: 0.038977 Sep 19 17:34:20.001825 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 505/1017] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Sep 19 17:34:19 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:22.587446 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ccf72b99-174f-4f19-bf20-61022be9c4a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2e3b695-780f-49bf-ae45-f8bcda9a227f"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:34:22.589976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ccf72b99-174f-4f19-bf20-61022be9c4a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:22.596302 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccf72b99-174f-4f19-bf20-61022be9c4a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:22.596785 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccf72b99-174f-4f19-bf20-61022be9c4a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:22.597726 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccf72b99-174f-4f19-bf20-61022be9c4a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:22.598414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccf72b99-174f-4f19-bf20-61022be9c4a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:22.598869 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccf72b99-174f-4f19-bf20-61022be9c4a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:22.599296 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccf72b99-174f-4f19-bf20-61022be9c4a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:23.366065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ccf72b99-174f-4f19-bf20-61022be9c4a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "POST /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783211 Sep 19 17:34:23.366874 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 513/1018] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:34:22 2022] POST /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments => generated 194 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:27.728535 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6464f04f-56da-4071-a8f0-0632c1fb3f4b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: .version_select at 0x7fd4d6397af0>, body: {"keypair": {"name": "tempest-keypair-524559316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+T8wl62yCOaD6AXOkjge+4yPWfxvLtut0ZZBhcOqITDgbDu0L+EeTrbu+f+XhZWcRS6O1Bm1qI/nWHaJflPR9jzXW6/+RBF+C5jtjXHDXwLvG1ZhsNFN2W+VBgL+ntXg=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:34:27.744791 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-6464f04f-56da-4071-a8f0-0632c1fb3f4b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:34:27.748653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-6464f04f-56da-4071-a8f0-0632c1fb3f4b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for user a8e4233c03174fa18deb6baad431543b and project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:34:27.805756 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6464f04f-56da-4071-a8f0-0632c1fb3f4b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081110 Sep 19 17:34:27.806304 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 506/1019] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Sep 19 17:34:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:34:29.944274 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-652932285", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee3141f2-3b76-40de-a3df-4fd096ef3d26"}], "security_groups": [{"name": "tempest-securitygroup--1821735114"}], "key_name": "tempest-keypair-524559316", "user_data": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:34:30.049536 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] validate_networks() for [('ee3141f2-3b76-40de-a3df-4fd096ef3d26', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:34:30.470695 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:34:30.471125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:34:30.471603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:34:30.472726 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:34:30.473143 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:34:30.481721 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:30.482206 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:30.482650 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:30.483395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:30.483903 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:30.484335 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:30.500748 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:34:30.504828 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for user a8e4233c03174fa18deb6baad431543b and project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:34:30.516050 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:34:30.518430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:34:30.657770 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [03356f9c-f8c6-4f21-95a8-b6805ecf5f66] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 17:34:31.666341 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [03356f9c-f8c6-4f21-95a8-b6805ecf5f66] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 49354. Sep 19 17:34:31.670579 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7205ad2d-4f86-4740-8c89-662b641bc36f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.731539 Sep 19 17:34:31.671406 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 514/1020] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:34:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:34:31.683311 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b09a77f-4e45-4064-a452-7399ade9bcac tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:31.684230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0b09a77f-4e45-4064-a452-7399ade9bcac tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:31.686909 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:31.746906 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0b09a77f-4e45-4064-a452-7399ade9bcac tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:31.755015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0b09a77f-4e45-4064-a452-7399ade9bcac tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1240 microversion: 2.1 time: 0.075678 Sep 19 17:34:31.755764 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 507/1021] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:31 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:32.778781 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-89b19443-a69a-491d-b416-62d81b47010e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:32.779327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-89b19443-a69a-491d-b416-62d81b47010e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:32.786306 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b19443-a69a-491d-b416-62d81b47010e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:32.786792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b19443-a69a-491d-b416-62d81b47010e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:32.787235 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b19443-a69a-491d-b416-62d81b47010e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:32.787953 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b19443-a69a-491d-b416-62d81b47010e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:32.788411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b19443-a69a-491d-b416-62d81b47010e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:32.788842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b19443-a69a-491d-b416-62d81b47010e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:32.847803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-89b19443-a69a-491d-b416-62d81b47010e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:32.855360 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-89b19443-a69a-491d-b416-62d81b47010e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1244 microversion: 2.1 time: 0.081201 Sep 19 17:34:32.855966 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 515/1022] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:32 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:33.878688 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b26ca89c-b6f1-4cce-a412-870f72d1f1a4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:33.879246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b26ca89c-b6f1-4cce-a412-870f72d1f1a4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:33.885756 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b26ca89c-b6f1-4cce-a412-870f72d1f1a4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:33.886247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b26ca89c-b6f1-4cce-a412-870f72d1f1a4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:33.886691 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b26ca89c-b6f1-4cce-a412-870f72d1f1a4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:33.887643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b26ca89c-b6f1-4cce-a412-870f72d1f1a4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:33.888139 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b26ca89c-b6f1-4cce-a412-870f72d1f1a4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:33.888575 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b26ca89c-b6f1-4cce-a412-870f72d1f1a4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:33.953956 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b26ca89c-b6f1-4cce-a412-870f72d1f1a4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:33.962133 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b26ca89c-b6f1-4cce-a412-870f72d1f1a4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1292 microversion: 2.1 time: 0.087463 Sep 19 17:34:33.978567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 508/1023] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:33 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:34.115937 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b50d6ab2-9cdf-4919-a4f1-86194683fd2e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:34.118206 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b50d6ab2-9cdf-4919-a4f1-86194683fd2e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:34.124910 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b50d6ab2-9cdf-4919-a4f1-86194683fd2e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:34.125403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b50d6ab2-9cdf-4919-a4f1-86194683fd2e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:34.125840 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b50d6ab2-9cdf-4919-a4f1-86194683fd2e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:34.126572 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b50d6ab2-9cdf-4919-a4f1-86194683fd2e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:34.127031 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b50d6ab2-9cdf-4919-a4f1-86194683fd2e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:34.127555 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b50d6ab2-9cdf-4919-a4f1-86194683fd2e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:34.161357 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b50d6ab2-9cdf-4919-a4f1-86194683fd2e tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048630 Sep 19 17:34:34.161840 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 516/1024] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:34:34 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:34.172789 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88b75e2c-5a3d-43de-b7eb-73cd66efb3a7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:34.173289 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88b75e2c-5a3d-43de-b7eb-73cd66efb3a7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:34.179120 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b75e2c-5a3d-43de-b7eb-73cd66efb3a7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:34.179608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b75e2c-5a3d-43de-b7eb-73cd66efb3a7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:34.180117 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b75e2c-5a3d-43de-b7eb-73cd66efb3a7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:34.180790 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b75e2c-5a3d-43de-b7eb-73cd66efb3a7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:34.181246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b75e2c-5a3d-43de-b7eb-73cd66efb3a7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:34.181673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b75e2c-5a3d-43de-b7eb-73cd66efb3a7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:34.211605 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88b75e2c-5a3d-43de-b7eb-73cd66efb3a7 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments/b2e3b695-780f-49bf-ae45-f8bcda9a227f" status: 200 len: 194 microversion: 2.1 time: 0.042732 Sep 19 17:34:34.212229 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 509/1025] 10.222.0.61 () {58 vars in 1413 bytes} [Mon Sep 19 17:34:34 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments/b2e3b695-780f-49bf-ae45-f8bcda9a227f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:34.986713 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-63e8c0bf-97f7-471a-8a8f-ae1a930f99c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:34.987239 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-63e8c0bf-97f7-471a-8a8f-ae1a930f99c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:34.993032 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63e8c0bf-97f7-471a-8a8f-ae1a930f99c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:34.993519 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63e8c0bf-97f7-471a-8a8f-ae1a930f99c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:34.993984 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63e8c0bf-97f7-471a-8a8f-ae1a930f99c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:34.994679 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63e8c0bf-97f7-471a-8a8f-ae1a930f99c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:34.995140 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63e8c0bf-97f7-471a-8a8f-ae1a930f99c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:34.995565 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63e8c0bf-97f7-471a-8a8f-ae1a930f99c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:35.057439 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-63e8c0bf-97f7-471a-8a8f-ae1a930f99c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:35.065575 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-63e8c0bf-97f7-471a-8a8f-ae1a930f99c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1298 microversion: 2.1 time: 0.083016 Sep 19 17:34:35.066150 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 517/1026] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:34 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:35.778571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8bcd306d-6f98-435c-a715-9a5f14d428a1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb032151-8672-488c-acb3-414aecc1dc50"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:34:35.781133 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8bcd306d-6f98-435c-a715-9a5f14d428a1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:35.788219 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bcd306d-6f98-435c-a715-9a5f14d428a1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:35.788807 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bcd306d-6f98-435c-a715-9a5f14d428a1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:35.789343 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bcd306d-6f98-435c-a715-9a5f14d428a1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:35.790129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bcd306d-6f98-435c-a715-9a5f14d428a1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:35.790594 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bcd306d-6f98-435c-a715-9a5f14d428a1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:35.791055 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bcd306d-6f98-435c-a715-9a5f14d428a1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:36.090854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b3b2d36e-1fa3-4722-91dd-0f05f069d990 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:36.091735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b3b2d36e-1fa3-4722-91dd-0f05f069d990 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:36.099362 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3b2d36e-1fa3-4722-91dd-0f05f069d990 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:36.100409 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3b2d36e-1fa3-4722-91dd-0f05f069d990 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:36.101430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3b2d36e-1fa3-4722-91dd-0f05f069d990 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:36.102710 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3b2d36e-1fa3-4722-91dd-0f05f069d990 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:36.103394 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3b2d36e-1fa3-4722-91dd-0f05f069d990 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:36.104069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3b2d36e-1fa3-4722-91dd-0f05f069d990 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:36.240651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b3b2d36e-1fa3-4722-91dd-0f05f069d990 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:36.248567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b3b2d36e-1fa3-4722-91dd-0f05f069d990 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1366 microversion: 2.1 time: 0.161894 Sep 19 17:34:36.249146 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 518/1027] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:36 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:34:36.259323 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4ed9420c-2d55-4611-a83a-9a395fd44a4d req-f35f8416-7464-4449-b2de-0b49317e00ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b92d3a-39ec-402d-a1e8-4f928fca00cc", "tag": "deb252e1-db69-4bba-b60a-285d384a6c3b"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:34:36.270087 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4ed9420c-2d55-4611-a83a-9a395fd44a4d req-f35f8416-7464-4449-b2de-0b49317e00ed service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:36.274952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4ed9420c-2d55-4611-a83a-9a395fd44a4d req-f35f8416-7464-4449-b2de-0b49317e00ed service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:36.274952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4ed9420c-2d55-4611-a83a-9a395fd44a4d req-f35f8416-7464-4449-b2de-0b49317e00ed service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:36.283628 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4ed9420c-2d55-4611-a83a-9a395fd44a4d req-f35f8416-7464-4449-b2de-0b49317e00ed service nova] Creating event network-changed:deb252e1-db69-4bba-b60a-285d384a6c3b for instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc on hv-cinder-84801 Sep 19 17:34:36.288715 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4ed9420c-2d55-4611-a83a-9a395fd44a4d req-f35f8416-7464-4449-b2de-0b49317e00ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032856 Sep 19 17:34:36.289414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 519/1028] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:34:36.427586 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8bcd306d-6f98-435c-a715-9a5f14d428a1 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "POST /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.652997 Sep 19 17:34:36.428332 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 510/1029] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:34:35 2022] POST /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments => generated 194 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:37.273508 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-72b0dc56-5cb4-4018-b6e5-68d0c97eb64a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:37.274123 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-72b0dc56-5cb4-4018-b6e5-68d0c97eb64a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:37.280269 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72b0dc56-5cb4-4018-b6e5-68d0c97eb64a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:37.281395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72b0dc56-5cb4-4018-b6e5-68d0c97eb64a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:37.281996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72b0dc56-5cb4-4018-b6e5-68d0c97eb64a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:37.282729 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72b0dc56-5cb4-4018-b6e5-68d0c97eb64a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:37.283204 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72b0dc56-5cb4-4018-b6e5-68d0c97eb64a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:37.283822 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72b0dc56-5cb4-4018-b6e5-68d0c97eb64a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:37.417208 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-72b0dc56-5cb4-4018-b6e5-68d0c97eb64a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:37.424963 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-72b0dc56-5cb4-4018-b6e5-68d0c97eb64a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1366 microversion: 2.1 time: 0.156289 Sep 19 17:34:37.425538 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 520/1030] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:37 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:38.450106 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1be8a83-a36f-43d4-94d3-7ddb6bae871e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:38.450842 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1be8a83-a36f-43d4-94d3-7ddb6bae871e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:38.457103 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1be8a83-a36f-43d4-94d3-7ddb6bae871e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:38.457596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1be8a83-a36f-43d4-94d3-7ddb6bae871e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:38.458074 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1be8a83-a36f-43d4-94d3-7ddb6bae871e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:38.458773 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1be8a83-a36f-43d4-94d3-7ddb6bae871e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:38.459233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1be8a83-a36f-43d4-94d3-7ddb6bae871e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:38.459664 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1be8a83-a36f-43d4-94d3-7ddb6bae871e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:38.588620 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1be8a83-a36f-43d4-94d3-7ddb6bae871e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:38.596889 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1be8a83-a36f-43d4-94d3-7ddb6bae871e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1366 microversion: 2.1 time: 0.151581 Sep 19 17:34:38.597460 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 511/1031] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:38 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:39.619912 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9bed2dd6-4328-415f-86a9-8405a5a49b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:39.620531 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9bed2dd6-4328-415f-86a9-8405a5a49b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:39.626855 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bed2dd6-4328-415f-86a9-8405a5a49b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:39.627338 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bed2dd6-4328-415f-86a9-8405a5a49b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:39.627840 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bed2dd6-4328-415f-86a9-8405a5a49b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:39.628548 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bed2dd6-4328-415f-86a9-8405a5a49b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:39.629004 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bed2dd6-4328-415f-86a9-8405a5a49b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:39.629460 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bed2dd6-4328-415f-86a9-8405a5a49b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:39.764075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9bed2dd6-4328-415f-86a9-8405a5a49b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:39.771715 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9bed2dd6-4328-415f-86a9-8405a5a49b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1366 microversion: 2.1 time: 0.155588 Sep 19 17:34:39.772294 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 521/1032] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:39 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:40.794382 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-605f2499-4723-4216-b779-7e7038cc2ba4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:40.794990 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-605f2499-4723-4216-b779-7e7038cc2ba4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:40.801447 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605f2499-4723-4216-b779-7e7038cc2ba4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:40.801929 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605f2499-4723-4216-b779-7e7038cc2ba4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:40.802370 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605f2499-4723-4216-b779-7e7038cc2ba4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:40.803062 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605f2499-4723-4216-b779-7e7038cc2ba4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:40.803517 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605f2499-4723-4216-b779-7e7038cc2ba4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:40.803977 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605f2499-4723-4216-b779-7e7038cc2ba4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:40.934228 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-605f2499-4723-4216-b779-7e7038cc2ba4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:40.941855 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-605f2499-4723-4216-b779-7e7038cc2ba4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1366 microversion: 2.1 time: 0.151412 Sep 19 17:34:40.942419 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 512/1033] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:40 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:41.965262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a90c4fef-f0cc-4d44-990e-250462b94bab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:41.965876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a90c4fef-f0cc-4d44-990e-250462b94bab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:41.968035 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:41.968713 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:41.974344 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c4fef-f0cc-4d44-990e-250462b94bab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:41.974825 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c4fef-f0cc-4d44-990e-250462b94bab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:41.975261 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c4fef-f0cc-4d44-990e-250462b94bab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:41.976061 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c4fef-f0cc-4d44-990e-250462b94bab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:41.976413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c4fef-f0cc-4d44-990e-250462b94bab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:41.976836 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c4fef-f0cc-4d44-990e-250462b94bab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:42.107422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a90c4fef-f0cc-4d44-990e-250462b94bab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:42.115106 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a90c4fef-f0cc-4d44-990e-250462b94bab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1366 microversion: 2.1 time: 0.153868 Sep 19 17:34:42.115718 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 522/1034] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:41 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:43.138610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54137e3c-5999-4d14-869f-8234d313143f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:43.139220 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54137e3c-5999-4d14-869f-8234d313143f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:43.141237 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:43.147058 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54137e3c-5999-4d14-869f-8234d313143f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:43.147544 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54137e3c-5999-4d14-869f-8234d313143f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:43.148015 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54137e3c-5999-4d14-869f-8234d313143f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:43.148714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54137e3c-5999-4d14-869f-8234d313143f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:43.149172 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54137e3c-5999-4d14-869f-8234d313143f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:43.149600 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54137e3c-5999-4d14-869f-8234d313143f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:43.279399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-54137e3c-5999-4d14-869f-8234d313143f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:43.287679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54137e3c-5999-4d14-869f-8234d313143f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1366 microversion: 2.1 time: 0.153221 Sep 19 17:34:43.288253 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 513/1035] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:43 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:44.050390 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-87121e16-eb4f-426c-833e-894e20ffd55d req-02b470b0-16b9-4439-b27f-c052d923507f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b92d3a-39ec-402d-a1e8-4f928fca00cc", "name": "network-vif-plugged", "status": "completed", "tag": "deb252e1-db69-4bba-b60a-285d384a6c3b"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:34:44.060061 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-87121e16-eb4f-426c-833e-894e20ffd55d req-02b470b0-16b9-4439-b27f-c052d923507f service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:44.060573 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-87121e16-eb4f-426c-833e-894e20ffd55d req-02b470b0-16b9-4439-b27f-c052d923507f service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:44.061002 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-87121e16-eb4f-426c-833e-894e20ffd55d req-02b470b0-16b9-4439-b27f-c052d923507f service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:44.072279 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-87121e16-eb4f-426c-833e-894e20ffd55d req-02b470b0-16b9-4439-b27f-c052d923507f service nova] Creating event network-vif-plugged:deb252e1-db69-4bba-b60a-285d384a6c3b for instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc on hv-cinder-84801 Sep 19 17:34:44.077551 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-87121e16-eb4f-426c-833e-894e20ffd55d req-02b470b0-16b9-4439-b27f-c052d923507f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190362 Sep 19 17:34:44.078194 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 523/1036] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:34:44.312679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71fde5cc-7f83-4a0a-a746-b4310a76ea45 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:44.312679 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-71fde5cc-7f83-4a0a-a746-b4310a76ea45 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:44.317888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71fde5cc-7f83-4a0a-a746-b4310a76ea45 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:44.318374 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71fde5cc-7f83-4a0a-a746-b4310a76ea45 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:44.319014 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71fde5cc-7f83-4a0a-a746-b4310a76ea45 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:44.319760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71fde5cc-7f83-4a0a-a746-b4310a76ea45 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:44.320226 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71fde5cc-7f83-4a0a-a746-b4310a76ea45 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:44.320656 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71fde5cc-7f83-4a0a-a746-b4310a76ea45 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:44.451519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-71fde5cc-7f83-4a0a-a746-b4310a76ea45 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:44.459829 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-71fde5cc-7f83-4a0a-a746-b4310a76ea45 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1366 microversion: 2.1 time: 0.153229 Sep 19 17:34:44.460414 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 514/1037] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:44 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:34:45.484087 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a91e2959-711f-4d8b-94d4-08db3e379672 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:45.484790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a91e2959-711f-4d8b-94d4-08db3e379672 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:45.491369 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a91e2959-711f-4d8b-94d4-08db3e379672 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:45.495473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a91e2959-711f-4d8b-94d4-08db3e379672 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:45.495473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a91e2959-711f-4d8b-94d4-08db3e379672 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:45.495473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a91e2959-711f-4d8b-94d4-08db3e379672 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:45.495473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a91e2959-711f-4d8b-94d4-08db3e379672 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:45.496078 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a91e2959-711f-4d8b-94d4-08db3e379672 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:45.629175 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a91e2959-711f-4d8b-94d4-08db3e379672 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:45.636900 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a91e2959-711f-4d8b-94d4-08db3e379672 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1366 microversion: 2.1 time: 0.157498 Sep 19 17:34:45.637784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 524/1038] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:45 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:46.659659 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1741e91-ec6a-40e8-8f6d-596da13d6bfb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:46.660341 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1741e91-ec6a-40e8-8f6d-596da13d6bfb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:46.666890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1741e91-ec6a-40e8-8f6d-596da13d6bfb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:46.667380 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1741e91-ec6a-40e8-8f6d-596da13d6bfb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:46.667859 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1741e91-ec6a-40e8-8f6d-596da13d6bfb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:46.668563 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1741e91-ec6a-40e8-8f6d-596da13d6bfb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:46.669024 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1741e91-ec6a-40e8-8f6d-596da13d6bfb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:46.669456 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1741e91-ec6a-40e8-8f6d-596da13d6bfb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:46.797277 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1741e91-ec6a-40e8-8f6d-596da13d6bfb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:46.805772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1741e91-ec6a-40e8-8f6d-596da13d6bfb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1366 microversion: 2.1 time: 0.150000 Sep 19 17:34:46.807860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 515/1039] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:46 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:47.829356 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ef6529b0-095f-4903-ad10-752bc4e1fc21 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:47.830095 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ef6529b0-095f-4903-ad10-752bc4e1fc21 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:47.837044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef6529b0-095f-4903-ad10-752bc4e1fc21 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:47.837519 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef6529b0-095f-4903-ad10-752bc4e1fc21 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:47.838544 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef6529b0-095f-4903-ad10-752bc4e1fc21 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:47.838651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef6529b0-095f-4903-ad10-752bc4e1fc21 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:47.839056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef6529b0-095f-4903-ad10-752bc4e1fc21 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:47.839476 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef6529b0-095f-4903-ad10-752bc4e1fc21 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:47.967950 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ef6529b0-095f-4903-ad10-752bc4e1fc21 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:47.975564 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ef6529b0-095f-4903-ad10-752bc4e1fc21 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1555 microversion: 2.1 time: 0.150095 Sep 19 17:34:47.976160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 525/1040] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:47 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:34:47.997622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-399998ca-a591-427c-b0fd-a88b45039345 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:47.998134 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-399998ca-a591-427c-b0fd-a88b45039345 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:48.005155 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-399998ca-a591-427c-b0fd-a88b45039345 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:48.005661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-399998ca-a591-427c-b0fd-a88b45039345 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:48.006087 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-399998ca-a591-427c-b0fd-a88b45039345 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:48.006788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-399998ca-a591-427c-b0fd-a88b45039345 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:48.007248 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-399998ca-a591-427c-b0fd-a88b45039345 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:48.007680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-399998ca-a591-427c-b0fd-a88b45039345 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:48.086504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-399998ca-a591-427c-b0fd-a88b45039345 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092715 Sep 19 17:34:48.087099 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 516/1041] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Sep 19 17:34:47 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:48.202696 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-964c3f96-287d-41e3-9e16-22b99dce2edd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:48.204982 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-964c3f96-287d-41e3-9e16-22b99dce2edd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:48.210860 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-964c3f96-287d-41e3-9e16-22b99dce2edd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:48.211351 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-964c3f96-287d-41e3-9e16-22b99dce2edd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:48.211895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-964c3f96-287d-41e3-9e16-22b99dce2edd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:48.212604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-964c3f96-287d-41e3-9e16-22b99dce2edd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:48.213068 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-964c3f96-287d-41e3-9e16-22b99dce2edd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:48.213499 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-964c3f96-287d-41e3-9e16-22b99dce2edd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:48.243557 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-964c3f96-287d-41e3-9e16-22b99dce2edd tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044777 Sep 19 17:34:48.244166 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 526/1042] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:34:48 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:48.384853 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8eeb9beb-a163-4849-bddb-2a9a43c84852 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:48.385441 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8eeb9beb-a163-4849-bddb-2a9a43c84852 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:48.391934 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eeb9beb-a163-4849-bddb-2a9a43c84852 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:48.392506 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eeb9beb-a163-4849-bddb-2a9a43c84852 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:48.393040 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eeb9beb-a163-4849-bddb-2a9a43c84852 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:48.393750 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eeb9beb-a163-4849-bddb-2a9a43c84852 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:48.394236 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eeb9beb-a163-4849-bddb-2a9a43c84852 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:48.394858 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eeb9beb-a163-4849-bddb-2a9a43c84852 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:48.424141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8eeb9beb-a163-4849-bddb-2a9a43c84852 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments/b2e3b695-780f-49bf-ae45-f8bcda9a227f" status: 200 len: 194 microversion: 2.1 time: 0.043218 Sep 19 17:34:48.424754 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 517/1043] 10.222.0.61 () {58 vars in 1413 bytes} [Mon Sep 19 17:34:48 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments/b2e3b695-780f-49bf-ae45-f8bcda9a227f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:48.441478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7123f0af-4da5-4059-bc13-108733c7b3a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:48.442770 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7123f0af-4da5-4059-bc13-108733c7b3a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:48.444568 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:48.449312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7123f0af-4da5-4059-bc13-108733c7b3a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:48.449803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7123f0af-4da5-4059-bc13-108733c7b3a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:48.450243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7123f0af-4da5-4059-bc13-108733c7b3a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:48.450940 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7123f0af-4da5-4059-bc13-108733c7b3a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:48.451396 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7123f0af-4da5-4059-bc13-108733c7b3a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:48.451849 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7123f0af-4da5-4059-bc13-108733c7b3a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:48.455784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:48.537201 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-7123f0af-4da5-4059-bc13-108733c7b3a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lazy-loading 'services' on Instance uuid 804ecd62-8779-426a-9cea-e9b6cef8b4b8 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:34:48.702837 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7123f0af-4da5-4059-bc13-108733c7b3a0 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "DELETE /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments/b2e3b695-780f-49bf-ae45-f8bcda9a227f" status: 202 len: 0 microversion: 2.1 time: 0.265072 Sep 19 17:34:48.703795 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 527/1044] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:34:48 2022] DELETE /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments/b2e3b695-780f-49bf-ae45-f8bcda9a227f => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:34:49.062865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c0ba2238-8764-4dd9-803b-dc5b47045a94 req-24ae0070-6e2a-42d6-88f5-8dab19d73720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b92d3a-39ec-402d-a1e8-4f928fca00cc", "tag": "deb252e1-db69-4bba-b60a-285d384a6c3b"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:34:49.073762 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c0ba2238-8764-4dd9-803b-dc5b47045a94 req-24ae0070-6e2a-42d6-88f5-8dab19d73720 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:49.074332 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c0ba2238-8764-4dd9-803b-dc5b47045a94 req-24ae0070-6e2a-42d6-88f5-8dab19d73720 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:49.074850 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c0ba2238-8764-4dd9-803b-dc5b47045a94 req-24ae0070-6e2a-42d6-88f5-8dab19d73720 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:49.086404 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c0ba2238-8764-4dd9-803b-dc5b47045a94 req-24ae0070-6e2a-42d6-88f5-8dab19d73720 service nova] Creating event network-changed:deb252e1-db69-4bba-b60a-285d384a6c3b for instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc on hv-cinder-84801 Sep 19 17:34:49.091633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c0ba2238-8764-4dd9-803b-dc5b47045a94 req-24ae0070-6e2a-42d6-88f5-8dab19d73720 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032492 Sep 19 17:34:49.092259 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 518/1045] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:50.892259 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-021efcc1-5a64-49f5-9d30-522b603c71a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:50.892843 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-021efcc1-5a64-49f5-9d30-522b603c71a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:50.898999 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-021efcc1-5a64-49f5-9d30-522b603c71a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:50.899481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-021efcc1-5a64-49f5-9d30-522b603c71a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:50.899958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-021efcc1-5a64-49f5-9d30-522b603c71a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:50.900648 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-021efcc1-5a64-49f5-9d30-522b603c71a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:50.901104 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-021efcc1-5a64-49f5-9d30-522b603c71a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:50.901531 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-021efcc1-5a64-49f5-9d30-522b603c71a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:50.932526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-021efcc1-5a64-49f5-9d30-522b603c71a4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments/bb032151-8672-488c-acb3-414aecc1dc50" status: 200 len: 194 microversion: 2.1 time: 0.045418 Sep 19 17:34:50.933104 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 528/1046] 10.222.0.61 () {58 vars in 1413 bytes} [Mon Sep 19 17:34:50 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments/bb032151-8672-488c-acb3-414aecc1dc50 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:50.944767 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b3b80771-5d10-4e1b-b544-f962fda44a26 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:50.945355 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b3b80771-5d10-4e1b-b544-f962fda44a26 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:50.951540 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3b80771-5d10-4e1b-b544-f962fda44a26 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:50.952073 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3b80771-5d10-4e1b-b544-f962fda44a26 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:50.952512 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3b80771-5d10-4e1b-b544-f962fda44a26 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:50.953206 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3b80771-5d10-4e1b-b544-f962fda44a26 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:50.953667 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3b80771-5d10-4e1b-b544-f962fda44a26 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:50.954097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3b80771-5d10-4e1b-b544-f962fda44a26 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:51.036176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b3b80771-5d10-4e1b-b544-f962fda44a26 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lazy-loading 'services' on Instance uuid 804ecd62-8779-426a-9cea-e9b6cef8b4b8 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:34:51.285208 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b3b80771-5d10-4e1b-b544-f962fda44a26 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "DELETE /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments/bb032151-8672-488c-acb3-414aecc1dc50" status: 202 len: 0 microversion: 2.1 time: 0.345073 Sep 19 17:34:51.286382 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 519/1047] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:34:50 2022] DELETE /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments/bb032151-8672-488c-acb3-414aecc1dc50 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:34:52.466844 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4759164f-206c-45e3-907f-e095e3666f87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:52.469275 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4759164f-206c-45e3-907f-e095e3666f87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:52.476596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4759164f-206c-45e3-907f-e095e3666f87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:52.477087 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4759164f-206c-45e3-907f-e095e3666f87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:52.477533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4759164f-206c-45e3-907f-e095e3666f87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:52.478240 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4759164f-206c-45e3-907f-e095e3666f87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:52.478700 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4759164f-206c-45e3-907f-e095e3666f87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:52.479133 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4759164f-206c-45e3-907f-e095e3666f87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:52.509061 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4759164f-206c-45e3-907f-e095e3666f87 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046251 Sep 19 17:34:52.509622 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 529/1048] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:34:52 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 17:34:52.629387 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3b5d2a1a-a470-4a5b-9125-aafe0603caba tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:52.631744 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3b5d2a1a-a470-4a5b-9125-aafe0603caba tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:52.638211 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5d2a1a-a470-4a5b-9125-aafe0603caba tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:52.638701 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5d2a1a-a470-4a5b-9125-aafe0603caba tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:52.639147 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5d2a1a-a470-4a5b-9125-aafe0603caba tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:52.639890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5d2a1a-a470-4a5b-9125-aafe0603caba tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:52.640358 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5d2a1a-a470-4a5b-9125-aafe0603caba tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:52.640788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5d2a1a-a470-4a5b-9125-aafe0603caba tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:52.670181 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3b5d2a1a-a470-4a5b-9125-aafe0603caba tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045696 Sep 19 17:34:52.670739 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 520/1049] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:34:52 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 17:34:52.735047 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ce6ec184-3cd7-47be-99e6-20d1fc609807 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:52.735546 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ce6ec184-3cd7-47be-99e6-20d1fc609807 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:52.741457 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce6ec184-3cd7-47be-99e6-20d1fc609807 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:52.741940 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce6ec184-3cd7-47be-99e6-20d1fc609807 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:52.742374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce6ec184-3cd7-47be-99e6-20d1fc609807 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:52.743062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce6ec184-3cd7-47be-99e6-20d1fc609807 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:52.743518 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce6ec184-3cd7-47be-99e6-20d1fc609807 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:52.743975 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce6ec184-3cd7-47be-99e6-20d1fc609807 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:52.768552 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ce6ec184-3cd7-47be-99e6-20d1fc609807 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:34:53.057124 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ce6ec184-3cd7-47be-99e6-20d1fc609807 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "DELETE /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 204 len: 0 microversion: 2.1 time: 0.325560 Sep 19 17:34:53.057865 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 530/1050] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:34:52 2022] DELETE /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:34:53.066072 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-494bf893-eb1f-4f57-9bff-21b8769d602f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:53.067192 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-494bf893-eb1f-4f57-9bff-21b8769d602f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:53.073462 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-494bf893-eb1f-4f57-9bff-21b8769d602f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:53.073958 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-494bf893-eb1f-4f57-9bff-21b8769d602f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:53.074400 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-494bf893-eb1f-4f57-9bff-21b8769d602f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:53.075102 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-494bf893-eb1f-4f57-9bff-21b8769d602f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:53.075566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-494bf893-eb1f-4f57-9bff-21b8769d602f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:53.076030 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-494bf893-eb1f-4f57-9bff-21b8769d602f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:53.210877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-494bf893-eb1f-4f57-9bff-21b8769d602f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:53.218693 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-494bf893-eb1f-4f57-9bff-21b8769d602f tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1674 microversion: 2.1 time: 0.156517 Sep 19 17:34:53.219267 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 521/1051] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:53 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:54.244515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0816c9d5-5a79-4ed5-8272-ba168977086c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:54.245236 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0816c9d5-5a79-4ed5-8272-ba168977086c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:54.251532 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0816c9d5-5a79-4ed5-8272-ba168977086c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:54.252061 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0816c9d5-5a79-4ed5-8272-ba168977086c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:54.252500 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0816c9d5-5a79-4ed5-8272-ba168977086c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:54.253190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0816c9d5-5a79-4ed5-8272-ba168977086c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:54.253644 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0816c9d5-5a79-4ed5-8272-ba168977086c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:54.254738 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0816c9d5-5a79-4ed5-8272-ba168977086c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:54.382084 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0816c9d5-5a79-4ed5-8272-ba168977086c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:54.390066 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0816c9d5-5a79-4ed5-8272-ba168977086c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1674 microversion: 2.1 time: 0.149835 Sep 19 17:34:54.390639 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 531/1052] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:54 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:55.414233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-13487a35-9a1a-4645-b8b6-7118f8877d18 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:55.414884 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-13487a35-9a1a-4645-b8b6-7118f8877d18 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:55.421390 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13487a35-9a1a-4645-b8b6-7118f8877d18 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:55.421881 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13487a35-9a1a-4645-b8b6-7118f8877d18 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:55.422324 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13487a35-9a1a-4645-b8b6-7118f8877d18 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:55.423105 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13487a35-9a1a-4645-b8b6-7118f8877d18 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:55.423570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13487a35-9a1a-4645-b8b6-7118f8877d18 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:55.424027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13487a35-9a1a-4645-b8b6-7118f8877d18 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:55.554598 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-13487a35-9a1a-4645-b8b6-7118f8877d18 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:55.562220 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-13487a35-9a1a-4645-b8b6-7118f8877d18 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1674 microversion: 2.1 time: 0.152395 Sep 19 17:34:55.562786 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 522/1053] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:55 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:56.554754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-967b7530-8713-46f8-89f4-4698bcc162b4 req-8cde25ab-0a20-4a0a-8933-b9626215f411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "804ecd62-8779-426a-9cea-e9b6cef8b4b8", "name": "network-vif-deleted", "tag": "347bef90-4a8a-425d-8f92-3356b072b80d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:34:56.565221 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-967b7530-8713-46f8-89f4-4698bcc162b4 req-8cde25ab-0a20-4a0a-8933-b9626215f411 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:56.565634 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-967b7530-8713-46f8-89f4-4698bcc162b4 req-8cde25ab-0a20-4a0a-8933-b9626215f411 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:56.566064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-967b7530-8713-46f8-89f4-4698bcc162b4 req-8cde25ab-0a20-4a0a-8933-b9626215f411 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:56.580151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-967b7530-8713-46f8-89f4-4698bcc162b4 req-8cde25ab-0a20-4a0a-8933-b9626215f411 service nova] Creating event network-vif-deleted:347bef90-4a8a-425d-8f92-3356b072b80d for instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 on hv-cinder-84801 Sep 19 17:34:56.585719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c96ac52-4cb0-402d-9401-338dc551ffab tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:56.592686 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-967b7530-8713-46f8-89f4-4698bcc162b4 req-8cde25ab-0a20-4a0a-8933-b9626215f411 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091084 Sep 19 17:34:56.593255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c96ac52-4cb0-402d-9401-338dc551ffab tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:56.593361 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 532/1054] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:34:56.595167 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c96ac52-4cb0-402d-9401-338dc551ffab tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:56.595808 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c96ac52-4cb0-402d-9401-338dc551ffab tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:56.596335 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c96ac52-4cb0-402d-9401-338dc551ffab tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:56.597084 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c96ac52-4cb0-402d-9401-338dc551ffab tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:56.598485 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c96ac52-4cb0-402d-9401-338dc551ffab tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:56.598917 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c96ac52-4cb0-402d-9401-338dc551ffab tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:56.619046 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:56.665279 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c96ac52-4cb0-402d-9401-338dc551ffab tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:56.674042 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c96ac52-4cb0-402d-9401-338dc551ffab tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1606 microversion: 2.1 time: 0.092795 Sep 19 17:34:56.674635 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 523/1055] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:56 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1606 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:34:57.236197 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-33c3cc1f-2a97-40aa-a655-d6af4c4f4a50 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:57.239037 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-33c3cc1f-2a97-40aa-a655-d6af4c4f4a50 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:57.245258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33c3cc1f-2a97-40aa-a655-d6af4c4f4a50 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:57.245821 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33c3cc1f-2a97-40aa-a655-d6af4c4f4a50 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:57.246463 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33c3cc1f-2a97-40aa-a655-d6af4c4f4a50 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:57.247175 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33c3cc1f-2a97-40aa-a655-d6af4c4f4a50 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:57.247633 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33c3cc1f-2a97-40aa-a655-d6af4c4f4a50 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:57.248089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33c3cc1f-2a97-40aa-a655-d6af4c4f4a50 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:57.279949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-33c3cc1f-2a97-40aa-a655-d6af4c4f4a50 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048016 Sep 19 17:34:57.280522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 533/1056] 10.222.0.61 () {60 vars in 1343 bytes} [Mon Sep 19 17:34:57 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:57.349146 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e89b8727-278d-4110-b1c4-6995b260c8d5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:57.349651 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e89b8727-278d-4110-b1c4-6995b260c8d5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:57.356475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e89b8727-278d-4110-b1c4-6995b260c8d5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:57.356970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e89b8727-278d-4110-b1c4-6995b260c8d5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:57.357414 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e89b8727-278d-4110-b1c4-6995b260c8d5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:57.358127 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e89b8727-278d-4110-b1c4-6995b260c8d5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:57.358593 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e89b8727-278d-4110-b1c4-6995b260c8d5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:57.359028 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e89b8727-278d-4110-b1c4-6995b260c8d5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:57.385769 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e89b8727-278d-4110-b1c4-6995b260c8d5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:34:57.697559 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:57.698177 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:57.704876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:57.705397 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:57.705850 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:57.706545 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:57.707057 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:57.707515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:57.714510 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e89b8727-278d-4110-b1c4-6995b260c8d5 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "DELETE /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 204 len: 0 microversion: 2.20 time: 0.369024 Sep 19 17:34:57.715116 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 524/1057] 10.222.0.61 () {60 vars in 1280 bytes} [Mon Sep 19 17:34:57 2022] DELETE /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 17:34:57.724510 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:57.725218 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:57.731056 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:57.731548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:57.732107 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:57.732746 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:57.733204 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:57.733660 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:57.741274 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:57.741760 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:57.742201 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:57.742653 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lazy-loading 'fault' on Instance uuid 804ecd62-8779-426a-9cea-e9b6cef8b4b8 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:34:57.784658 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:57.793024 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-be13a593-c153-41e3-a8ec-70545fc74f81 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1328 microversion: 2.1 time: 0.099365 Sep 19 17:34:57.793608 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 534/1058] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:57 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:34:57.877808 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:57.886057 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:57.887785 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:57.888968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee909ff9-8b67-4cfb-a96f-a9508ea5caa6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.169268 Sep 19 17:34:57.889537 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 525/1059] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:34:57 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:34:58.817200 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:58.817801 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:58.824170 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:58.824651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:58.825086 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:58.825771 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:58.826225 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:58.826644 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:58.857257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:58.857732 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:58.858166 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:58.858606 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lazy-loading 'fault' on Instance uuid 804ecd62-8779-426a-9cea-e9b6cef8b4b8 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:34:58.901004 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e1832300e44d20be53e84933b97faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4225a4c3567f43208ad1663eec41c56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:58.909287 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a2da4099-4665-4eda-85d6-8217b28e4354 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 200 len: 1328 microversion: 2.1 time: 0.096452 Sep 19 17:34:58.910075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 535/1060] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:58 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:34:58.916223 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:58.916841 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:58.920619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:34:58.925322 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:58.928384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:58.928384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:58.928384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:58.928384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:58.928753 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:59.064988 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:59.073378 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:59.074762 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:34:59.075970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3fc38560-f1dc-4add-91d7-5d9147aeb8b3 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1722 microversion: 2.20 time: 0.164776 Sep 19 17:34:59.076538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 526/1061] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:34:58 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:34:59.932337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:34:59.933126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:34:59.939600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:59.940109 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:59.940574 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:59.941875 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:34:59.942331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:34:59.942754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:34:59.956142 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] HTTP exception thrown: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Request method failure captured: Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 HTTP/1.1 Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKXuRNHo653P_P7ft4Su0SDlR9SpNGM4bSV6VFfZeMEH8eHiGGbmo260h3sz4OyuM27Q9DK4BRmZzd8fuGK72q-DlYgYSJJ8SlUmkZ2aqq36jAigmj0ZUvtM5Ab7NJl8O-aDyRwsD1B8jkZ9HrGLN5nfmiopUkUE_2Us4HVSfNaPl0M Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:34:59.958596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}] Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 69e1832300e44d20be53e84933b97faa Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:34:59.960373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '804ecd62-8779-426a-9cea-e9b6cef8b4b8'} Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:34:59.961278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:34:59.962758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:34:59.964883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Returning 404 to user: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:34:59.964883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-28f40e3b-c769-48d9-a714-99410298c667 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 404 len: 111 microversion: 2.1 time: 0.031483 Sep 19 17:34:59.964883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 536/1062] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:34:59 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:34:59.969667 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d7ed55f3-6282-4f52-9b3a-2e10b7193a5c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '.version_select at 0x7fd4d6111160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:00.061973 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d7ed55f3-6282-4f52-9b3a-2e10b7193a5c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314343545" status: 202 len: 0 microversion: 2.1 time: 0.096194 Sep 19 17:35:00.062573 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 527/1063] 10.222.0.61 () {58 vars in 1221 bytes} [Mon Sep 19 17:34:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314343545 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:35:00.101475 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:00.102085 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:35:00.108000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:00.108485 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:00.108922 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:00.109616 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:00.110170 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:00.110641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:00.177597 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:35:00.187889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:35:00.189328 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:35:00.190613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25398e32-01e5-4aa7-ab67-3e40db75afa2 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1655 microversion: 2.20 time: 0.093223 Sep 19 17:35:00.191227 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 537/1064] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:35:00 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1655 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 17:35:00.574545 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b7e610f7-269f-4e79-aa2d-3e1cc90ac222 req-493fe6d0-f756-4335-b462-958555564408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bea192-300a-4359-90a1-81ad16a35d10", "name": "network-vif-deleted", "tag": "11cb86d3-62be-4d60-8b1e-e8a216766190"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:35:00.595977 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b7e610f7-269f-4e79-aa2d-3e1cc90ac222 req-493fe6d0-f756-4335-b462-958555564408 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:00.596819 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b7e610f7-269f-4e79-aa2d-3e1cc90ac222 req-493fe6d0-f756-4335-b462-958555564408 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:00.598862 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b7e610f7-269f-4e79-aa2d-3e1cc90ac222 req-493fe6d0-f756-4335-b462-958555564408 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:00.616960 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b7e610f7-269f-4e79-aa2d-3e1cc90ac222 req-493fe6d0-f756-4335-b462-958555564408 service nova] Creating event network-vif-deleted:11cb86d3-62be-4d60-8b1e-e8a216766190 for instance 70bea192-300a-4359-90a1-81ad16a35d10 on hv-cinder-84801 Sep 19 17:35:00.623504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b7e610f7-269f-4e79-aa2d-3e1cc90ac222 req-493fe6d0-f756-4335-b462-958555564408 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054654 Sep 19 17:35:00.625088 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 528/1065] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:35:01.217491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:01.218040 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:35:01.225415 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:01.225906 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:01.226358 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:01.227067 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:01.227530 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:01.227994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:01.265515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:01.266028 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:01.266526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:01.266943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lazy-loading 'fault' on Instance uuid 70bea192-300a-4359-90a1-81ad16a35d10 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:35:01.314703 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:35:01.323389 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:35:01.324971 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c1fb1574d854a14bde2333da340d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f148193008640639adb751706133b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:35:01.326115 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c75b6f7a-3197-4ee7-9d37-0296ee337415 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 200 len: 1371 microversion: 2.20 time: 0.112650 Sep 19 17:35:01.326665 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 538/1066] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:35:01 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 17:35:02.353562 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:02.354210 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:35:02.360920 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:02.361415 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:02.361858 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:02.362573 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:02.363783 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:02.364216 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:02.378707 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] HTTP exception thrown: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Request method failure captured: Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 HTTP/1.1 Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWIu8ZcFF9ScxyAL9gmWOCLMAOwgMyeN1oWftbRZnv6hH770WCtX79cGySDWWxN2V7SlIukjpwT3bDpnIYXdgr6pBpAkfD8voFe-jXCI9ZHOS4rDY4e8yAvq_36Q9x-86nhKHjiskPh7zsqwcm7J6WUJ4W5WdEHZ_Hj6uNUXa_lfcc Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 1f148193008640639adb751706133b25 Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:35:02.380524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1f148193008640639adb751706133b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1f148193008640639adb751706133b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}] Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 1f148193008640639adb751706133b25 Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 5c1fb1574d854a14bde2333da340d6a4 Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:02.382233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '70bea192-300a-4359-90a1-81ad16a35d10'} Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:35:02.383045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:02.384533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:02.385747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Returning 404 to user: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:35:02.385747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74d9c720-94e4-4dc2-9c17-748b5899e2cc tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 404 len: 111 microversion: 2.20 time: 0.033242 Sep 19 17:35:02.385747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 529/1067] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:35:02 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 17:35:02.391495 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-96a3c958-2453-4b8d-a51a-d4128e66fec9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '.version_select at 0x7fd4d604cb80>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:02.509193 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-96a3c958-2453-4b8d-a51a-d4128e66fec9 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809300722" status: 204 len: 0 microversion: 2.20 time: 0.121489 Sep 19 17:35:02.509809 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 539/1068] 10.222.0.61 () {60 vars in 1262 bytes} [Mon Sep 19 17:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809300722 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 17:35:03.672446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:03.672948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:35:03.679479 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:03.680016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:03.680468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:03.681181 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:03.681653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:03.682110 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:03.696680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] HTTP exception thrown: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Request method failure captured: Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 HTTP/1.1 Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKXuRNHo653P_P7ft4Su0SDlR9SpNGM4bSV6VFfZeMEH8eHiGGbmo260h3sz4OyuM27Q9DK4BRmZzd8fuGK72q-DlYgYSJJ8SlUmkZ2aqq36jAigmj0ZUvtM5Ab7NJl8O-aDyRwsD1B8jkZ9HrGLN5nfmiopUkUE_2Us4HVSfNaPl0M Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:35:03.698227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}] Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 69e1832300e44d20be53e84933b97faa Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:35:03.699923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '804ecd62-8779-426a-9cea-e9b6cef8b4b8'} Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:35:03.701431 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:35:03.703588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:03.705507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Returning 404 to user: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:35:03.705507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb5d2976-ca38-4741-a466-45db9931455c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "DELETE /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 404 len: 111 microversion: 2.1 time: 0.031054 Sep 19 17:35:03.705507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 530/1069] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:35:03 2022] DELETE /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:35:03.709358 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:03.709972 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: 804ecd62-8779-426a-9cea-e9b6cef8b4b8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:35:03.716762 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:03.717257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:03.717700 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:03.718411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:03.718866 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:03.719301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:03.734691 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] HTTP exception thrown: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Request method failure captured: Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 HTTP/1.1 Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKXuRNHo653P_P7ft4Su0SDlR9SpNGM4bSV6VFfZeMEH8eHiGGbmo260h3sz4OyuM27Q9DK4BRmZzd8fuGK72q-DlYgYSJJ8SlUmkZ2aqq36jAigmj0ZUvtM5Ab7NJl8O-aDyRwsD1B8jkZ9HrGLN5nfmiopUkUE_2Us4HVSfNaPl0M Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:35:03.736320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}] Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 69e1832300e44d20be53e84933b97faa Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:35:03.737935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '804ecd62-8779-426a-9cea-e9b6cef8b4b8'} Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:35:03.739395 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. Sep 19 17:35:03.740911 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:03.742283 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Returning 404 to user: Instance 804ecd62-8779-426a-9cea-e9b6cef8b4b8 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:35:03.742283 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1ad5a219-bb2c-4edd-8161-f454920a0bc3 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8" status: 404 len: 111 microversion: 2.1 time: 0.033489 Sep 19 17:35:03.742283 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 540/1070] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:35:03 2022] GET /compute/v2.1/servers/804ecd62-8779-426a-9cea-e9b6cef8b4b8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:35:04.646968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:04.647471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:35:04.653597 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:04.653865 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:04.654300 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:04.655001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:04.655457 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:04.655917 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:04.671105 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] HTTP exception thrown: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Request method failure captured: Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 HTTP/1.1 Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWIu8ZcFF9ScxyAL9gmWOCLMAOwgMyeN1oWftbRZnv6hH770WCtX79cGySDWWxN2V7SlIukjpwT3bDpnIYXdgr6pBpAkfD8voFe-jXCI9ZHOS4rDY4e8yAvq_36Q9x-86nhKHjiskPh7zsqwcm7J6WUJ4W5WdEHZ_Hj6uNUXa_lfcc Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 1f148193008640639adb751706133b25 Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:35:04.672696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1f148193008640639adb751706133b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1f148193008640639adb751706133b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}] Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 1f148193008640639adb751706133b25 Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 5c1fb1574d854a14bde2333da340d6a4 Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:04.675640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '70bea192-300a-4359-90a1-81ad16a35d10'} Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:35:04.676595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:04.679077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:04.680772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Returning 404 to user: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:35:04.680772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e00c146a-def6-4a5c-865c-3a5a7af522e6 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "DELETE /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 404 len: 111 microversion: 2.20 time: 0.031088 Sep 19 17:35:04.680772 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 531/1071] 10.222.0.61 () {60 vars in 1280 bytes} [Mon Sep 19 17:35:04 2022] DELETE /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 17:35:04.683651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:04.684282 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 70bea192-300a-4359-90a1-81ad16a35d10] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:35:04.690525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:04.691000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:04.691430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:04.692136 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:04.692804 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:04.693235 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:04.706824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] HTTP exception thrown: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Request method failure captured: Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 HTTP/1.1 Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKWIu8ZcFF9ScxyAL9gmWOCLMAOwgMyeN1oWftbRZnv6hH770WCtX79cGySDWWxN2V7SlIukjpwT3bDpnIYXdgr6pBpAkfD8voFe-jXCI9ZHOS4rDY4e8yAvq_36Q9x-86nhKHjiskPh7zsqwcm7J6WUJ4W5WdEHZ_Hj6uNUXa_lfcc Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 1f148193008640639adb751706133b25 Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:35:04.709205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1f148193008640639adb751706133b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1f148193008640639adb751706133b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}] Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 1f148193008640639adb751706133b25 Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 5c1fb1574d854a14bde2333da340d6a4 Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:04.711441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '70bea192-300a-4359-90a1-81ad16a35d10'} Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:35:04.712386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. Sep 19 17:35:04.713852 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:04.715102 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Returning 404 to user: Instance 70bea192-300a-4359-90a1-81ad16a35d10 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:35:04.715102 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-91eb8f35-7fb3-4ab3-a4f4-999c61c76e9c tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10" status: 404 len: 111 microversion: 2.20 time: 0.031309 Sep 19 17:35:04.715102 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 541/1072] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:35:04 2022] GET /compute/v2.1/servers/70bea192-300a-4359-90a1-81ad16a35d10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 17:35:05.016420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:05.016921 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:35:05.023386 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:05.023918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:05.024362 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:05.025126 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:05.025589 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:05.026025 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:05.040598 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] HTTP exception thrown: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Request method failure captured: Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b HTTP/1.1 Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKXuRNHo653P_P7ft4Su0SDlR9SpNGM4bSV6VFfZeMEH8eHiGGbmo260h3sz4OyuM27Q9DK4BRmZzd8fuGK72q-DlYgYSJJ8SlUmkZ2aqq36jAigmj0ZUvtM5Ab7NJl8O-aDyRwsD1B8jkZ9HrGLN5nfmiopUkUE_2Us4HVSfNaPl0M Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:35:05.042193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}] Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 69e1832300e44d20be53e84933b97faa Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:35:05.043963 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': 'e33b5624-bc7c-4818-8aa5-584440fe803b'} Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:35:05.045039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:35:05.046518 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:05.048278 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Returning 404 to user: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:35:05.048278 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2bf024f3-e987-4ffc-a656-ed7f6320506c tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 404 len: 111 microversion: 2.1 time: 0.031882 Sep 19 17:35:05.048278 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 532/1073] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:35:05 2022] DELETE /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:35:05.052439 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:05.053064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] [instance: e33b5624-bc7c-4818-8aa5-584440fe803b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:35:05.059158 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:05.059854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:05.060309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:05.061167 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:05.061639 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:05.062073 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:05.076442 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] HTTP exception thrown: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Request method failure captured: Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b HTTP/1.1 Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKXuRNHo653P_P7ft4Su0SDlR9SpNGM4bSV6VFfZeMEH8eHiGGbmo260h3sz4OyuM27Q9DK4BRmZzd8fuGK72q-DlYgYSJJ8SlUmkZ2aqq36jAigmj0ZUvtM5Ab7NJl8O-aDyRwsD1B8jkZ9HrGLN5nfmiopUkUE_2Us4HVSfNaPl0M Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:35:05.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4225a4c3567f43208ad1663eec41c56d"}]}] Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 4225a4c3567f43208ad1663eec41c56d Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1328104224 Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 69e1832300e44d20be53e84933b97faa Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeTestJSON-1328104224-project Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:35:05.079386 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': 'e33b5624-bc7c-4818-8aa5-584440fe803b'} Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:35:05.080164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. Sep 19 17:35:05.081423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:05.082775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] Returning 404 to user: Instance e33b5624-bc7c-4818-8aa5-584440fe803b could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:35:05.082775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4909b7e8-002e-466e-873a-5fac88324cb4 tempest-AttachVolumeTestJSON-1328104224 tempest-AttachVolumeTestJSON-1328104224-project] 10.222.0.61 "GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b" status: 404 len: 111 microversion: 2.1 time: 0.030946 Sep 19 17:35:05.082775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 542/1074] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:35:05 2022] GET /compute/v2.1/servers/e33b5624-bc7c-4818-8aa5-584440fe803b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:35:06.012790 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:06.013308 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:35:06.019961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:06.020455 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:06.020901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:06.025062 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:06.025062 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:06.025062 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:06.035783 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] HTTP exception thrown: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Request method failure captured: Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 HTTP/1.1 Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKWIu8ZcFF9ScxyAL9gmWOCLMAOwgMyeN1oWftbRZnv6hH770WCtX79cGySDWWxN2V7SlIukjpwT3bDpnIYXdgr6pBpAkfD8voFe-jXCI9ZHOS4rDY4e8yAvq_36Q9x-86nhKHjiskPh7zsqwcm7J6WUJ4W5WdEHZ_Hj6uNUXa_lfcc Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 1f148193008640639adb751706133b25 Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:35:06.037971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1f148193008640639adb751706133b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1f148193008640639adb751706133b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}] Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 1f148193008640639adb751706133b25 Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 5c1fb1574d854a14bde2333da340d6a4 Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:35:06.039673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '8d2eb485-3b5a-4326-bd4f-9029da4e6744'} Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:35:06.040536 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:35:06.041962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:35:06.044025 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Returning 404 to user: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:35:06.044025 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f2d28f41-25da-4e14-a3e3-61fbb5322541 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 404 len: 111 microversion: 2.20 time: 0.030720 Sep 19 17:35:06.044025 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 533/1075] 10.222.0.61 () {60 vars in 1280 bytes} [Mon Sep 19 17:35:06 2022] DELETE /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 17:35:06.048150 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:35:06.048792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] [instance: 8d2eb485-3b5a-4326-bd4f-9029da4e6744] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:35:06.056489 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:06.063988 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:06.063988 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:06.063988 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:35:06.063988 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:35:06.064641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:35:06.072740 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] HTTP exception thrown: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Request method failure captured: Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 HTTP/1.1 Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKWIu8ZcFF9ScxyAL9gmWOCLMAOwgMyeN1oWftbRZnv6hH770WCtX79cGySDWWxN2V7SlIukjpwT3bDpnIYXdgr6pBpAkfD8voFe-jXCI9ZHOS4rDY4e8yAvq_36Q9x-86nhKHjiskPh7zsqwcm7J6WUJ4W5WdEHZ_Hj6uNUXa_lfcc Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 1f148193008640639adb751706133b25 Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:35:06.074331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1f148193008640639adb751706133b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1f148193008640639adb751706133b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f148193008640639adb751706133b25"}]}] Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 1f148193008640639adb751706133b25 Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49785946 Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 5c1fb1574d854a14bde2333da340d6a4 Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49785946-project Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:35:06.078243 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '8d2eb485-3b5a-4326-bd4f-9029da4e6744'} Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:35:06.079754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. Sep 19 17:35:06.082672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:35:06.095130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] Returning 404 to user: Instance 8d2eb485-3b5a-4326-bd4f-9029da4e6744 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:35:06.095130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-038854b9-803a-48fe-9179-3504bf8d8940 tempest-AttachVolumeShelveTestJSON-49785946 tempest-AttachVolumeShelveTestJSON-49785946-project] 10.222.0.61 "GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744" status: 404 len: 111 microversion: 2.20 time: 0.031543 Sep 19 17:35:06.095130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 543/1076] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Sep 19 17:35:06 2022] GET /compute/v2.1/servers/8d2eb485-3b5a-4326-bd4f-9029da4e6744 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 17:36:37.513137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 17:36:37.513937 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Mon Sep 19 17:36:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc/ips (ip 10.222.0.61) !!! Sep 19 17:36:37.519411 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:36:37.520211 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:36:37.529047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a7919261-fd9d-4fbe-badc-44a97d7373f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:37.529471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a7919261-fd9d-4fbe-badc-44a97d7373f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:37.538705 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7919261-fd9d-4fbe-badc-44a97d7373f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:37.539197 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7919261-fd9d-4fbe-badc-44a97d7373f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:37.539664 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7919261-fd9d-4fbe-badc-44a97d7373f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:37.540390 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7919261-fd9d-4fbe-badc-44a97d7373f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:37.541077 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7919261-fd9d-4fbe-badc-44a97d7373f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:37.541513 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7919261-fd9d-4fbe-badc-44a97d7373f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:37.566116 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a7919261-fd9d-4fbe-badc-44a97d7373f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc/ips" status: 200 len: 149 microversion: 2.1 time: 0.055417 Sep 19 17:36:37.566702 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 534/1077] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Sep 19 17:36:37 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:36:37.576641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c610d08-85d8-46b8-92e6-dbcd57984c58] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 17:36:37.581285 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:36:37.581285 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:36:37.583389 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a520123-d4d7-4bf7-a602-2061fd778e2c"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:36:37.585770 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:37.591952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:37.592442 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:37.592932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:37.593816 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:37.594278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:37.594712 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:37.685011 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Invalid volume: volume 9a520123-d4d7-4bf7-a602-2061fd778e2c is already attached to instances: 3a67add5-c558-4f0e-ad79-5b1683cfbee3 Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc/os-volume_attachments HTTP/1.1 Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 74 Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:36:37.686623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {"volumeAttachment": {"volumeId": "9a520123-d4d7-4bf7-a602-2061fd778e2c"}} Sep 19 17:36:37.689125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Invalid volume: volume 9a520123-d4d7-4bf7-a602-2061fd778e2c is already attached to instances: 3a67add5-c558-4f0e-ad79-5b1683cfbee3 Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'server_id': '35b92d3a-39ec-402d-a1e8-4f928fca00cc', 'body': {'volumeAttachment': {'volumeId': '9a520123-d4d7-4bf7-a602-2061fd778e2c'}}} Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9a520123-d4d7-4bf7-a602-2061fd778e2c is already attached to instances: 3a67add5-c558-4f0e-ad79-5b1683cfbee3 Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:36:37.690664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9a520123-d4d7-4bf7-a602-2061fd778e2c is already attached to instances: 3a67add5-c558-4f0e-ad79-5b1683cfbee3 Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:36:37.692682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:36:37.694550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:36:37.694550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:36:37.694550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:36:37.694550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9a520123-d4d7-4bf7-a602-2061fd778e2c is already attached to instances: 3a67add5-c558-4f0e-ad79-5b1683cfbee3 Sep 19 17:36:37.694550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:36:37.694550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 400 to user: Invalid volume: volume 9a520123-d4d7-4bf7-a602-2061fd778e2c is already attached to instances: 3a67add5-c558-4f0e-ad79-5b1683cfbee3 {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:36:37.694550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bcd5628e-39c4-4fe5-9960-87470a0208f8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113633 Sep 19 17:36:37.694550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 544/1078] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:36:37 2022] POST /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 17:36:37.697293 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6687cf3-b950-496d-a653-e42f70566dd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:37.697818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6687cf3-b950-496d-a653-e42f70566dd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:37.704967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6687cf3-b950-496d-a653-e42f70566dd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:37.713548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6687cf3-b950-496d-a653-e42f70566dd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:37.713548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6687cf3-b950-496d-a653-e42f70566dd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:37.713548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6687cf3-b950-496d-a653-e42f70566dd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:37.713548 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6687cf3-b950-496d-a653-e42f70566dd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:37.714403 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6687cf3-b950-496d-a653-e42f70566dd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:37.734733 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6687cf3-b950-496d-a653-e42f70566dd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:36:38.101118 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6687cf3-b950-496d-a653-e42f70566dd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 204 len: 0 microversion: 2.1 time: 0.407680 Sep 19 17:36:38.101725 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 535/1079] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:36:37 2022] DELETE /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:36:38.110339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6bcad2e6-5ae1-4942-a6a8-e0ce5c2f6e07 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:38.110842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6bcad2e6-5ae1-4942-a6a8-e0ce5c2f6e07 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:38.119912 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcad2e6-5ae1-4942-a6a8-e0ce5c2f6e07 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:38.120404 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcad2e6-5ae1-4942-a6a8-e0ce5c2f6e07 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:38.120845 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcad2e6-5ae1-4942-a6a8-e0ce5c2f6e07 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:38.121548 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcad2e6-5ae1-4942-a6a8-e0ce5c2f6e07 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:38.122004 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcad2e6-5ae1-4942-a6a8-e0ce5c2f6e07 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:38.122438 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcad2e6-5ae1-4942-a6a8-e0ce5c2f6e07 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:38.257474 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6bcad2e6-5ae1-4942-a6a8-e0ce5c2f6e07 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:36:38.265587 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6bcad2e6-5ae1-4942-a6a8-e0ce5c2f6e07 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1680 microversion: 2.1 time: 0.159340 Sep 19 17:36:38.266248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 545/1080] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:38 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:36:39.294373 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e90402dd-2ba9-48e9-a11b-7402689e29ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:39.295078 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e90402dd-2ba9-48e9-a11b-7402689e29ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:39.303128 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e90402dd-2ba9-48e9-a11b-7402689e29ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:39.303618 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e90402dd-2ba9-48e9-a11b-7402689e29ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:39.304088 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e90402dd-2ba9-48e9-a11b-7402689e29ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:39.304839 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e90402dd-2ba9-48e9-a11b-7402689e29ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:39.305397 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e90402dd-2ba9-48e9-a11b-7402689e29ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:39.305841 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e90402dd-2ba9-48e9-a11b-7402689e29ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:39.449399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e90402dd-2ba9-48e9-a11b-7402689e29ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:36:39.457955 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e90402dd-2ba9-48e9-a11b-7402689e29ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1680 microversion: 2.1 time: 0.168391 Sep 19 17:36:39.458619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 536/1081] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:39 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:36:40.483085 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1344e3ea-051e-4192-a221-450bf91f1249 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:40.484289 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1344e3ea-051e-4192-a221-450bf91f1249 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:40.507129 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1344e3ea-051e-4192-a221-450bf91f1249 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:40.508526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1344e3ea-051e-4192-a221-450bf91f1249 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:40.509301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1344e3ea-051e-4192-a221-450bf91f1249 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:40.511131 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1344e3ea-051e-4192-a221-450bf91f1249 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:40.511958 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1344e3ea-051e-4192-a221-450bf91f1249 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:40.512406 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1344e3ea-051e-4192-a221-450bf91f1249 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:40.546162 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c610d08-85d8-46b8-92e6-dbcd57984c58] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 50962. Sep 19 17:36:40.677832 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1344e3ea-051e-4192-a221-450bf91f1249 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:36:40.686232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1344e3ea-051e-4192-a221-450bf91f1249 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1680 microversion: 2.1 time: 0.208136 Sep 19 17:36:40.686814 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 546/1082] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:40 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:36:41.168475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e1667801-b99e-44f1-ac02-c9c9db5a084a req-8302bd32-b5a4-43ed-ab2e-b32ccdc0d4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b92d3a-39ec-402d-a1e8-4f928fca00cc", "name": "network-vif-deleted", "tag": "deb252e1-db69-4bba-b60a-285d384a6c3b"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:36:41.180498 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e1667801-b99e-44f1-ac02-c9c9db5a084a req-8302bd32-b5a4-43ed-ab2e-b32ccdc0d4ac service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:41.181157 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e1667801-b99e-44f1-ac02-c9c9db5a084a req-8302bd32-b5a4-43ed-ab2e-b32ccdc0d4ac service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:41.182168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e1667801-b99e-44f1-ac02-c9c9db5a084a req-8302bd32-b5a4-43ed-ab2e-b32ccdc0d4ac service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:41.205698 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-e1667801-b99e-44f1-ac02-c9c9db5a084a req-8302bd32-b5a4-43ed-ab2e-b32ccdc0d4ac service nova] Creating event network-vif-deleted:deb252e1-db69-4bba-b60a-285d384a6c3b for instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc on hv-cinder-84801 Sep 19 17:36:41.225512 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e1667801-b99e-44f1-ac02-c9c9db5a084a req-8302bd32-b5a4-43ed-ab2e-b32ccdc0d4ac service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060535 Sep 19 17:36:41.227217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 537/1083] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:36:41.724819 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:41.725456 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:41.741780 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:41.742514 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:41.743131 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:41.744314 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:41.744995 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:41.745606 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:41.787769 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:41.788312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:41.788816 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:41.789217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lazy-loading 'fault' on Instance uuid 35b92d3a-39ec-402d-a1e8-4f928fca00cc {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:36:41.846267 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:36:41.854527 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7b251103-3708-40b2-80af-dacc6aa96a3e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 200 len: 1330 microversion: 2.1 time: 0.146120 Sep 19 17:36:41.855327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 547/1084] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:41 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 1330 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:36:42.885316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:42.886149 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:42.893461 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:42.893967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:42.894435 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:42.895142 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:42.895599 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:42.896141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:42.911608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc HTTP/1.1 Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:36:42.913097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:36:42.915115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '35b92d3a-39ec-402d-a1e8-4f928fca00cc'} Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:36:42.916036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:36:42.918292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:36:42.920274 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:36:42.920274 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9d1de6ca-50f7-4c2b-a139-04d71950ac95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 404 len: 111 microversion: 2.1 time: 0.039827 Sep 19 17:36:42.920274 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 538/1085] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:42 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:36:42.923663 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7fafadb8-cd44-4973-868e-c5600f1d9d9d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '.version_select at 0x7fd4d9877af0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:43.034968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7fafadb8-cd44-4973-868e-c5600f1d9d9d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-524559316" status: 202 len: 0 microversion: 2.1 time: 0.114291 Sep 19 17:36:43.035904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 548/1086] 10.222.0.61 () {58 vars in 1218 bytes} [Mon Sep 19 17:36:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-524559316 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:36:43.966478 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e06510ae-29a8-4022-941a-ee6888cdbd20 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:43.967018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e06510ae-29a8-4022-941a-ee6888cdbd20 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:43.974053 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06510ae-29a8-4022-941a-ee6888cdbd20 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:43.974538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06510ae-29a8-4022-941a-ee6888cdbd20 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:43.974972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06510ae-29a8-4022-941a-ee6888cdbd20 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:43.975660 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06510ae-29a8-4022-941a-ee6888cdbd20 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:43.976173 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06510ae-29a8-4022-941a-ee6888cdbd20 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:43.976570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06510ae-29a8-4022-941a-ee6888cdbd20 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:44.063925 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e06510ae-29a8-4022-941a-ee6888cdbd20 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lazy-loading 'services' on Instance uuid 3a67add5-c558-4f0e-ad79-5b1683cfbee3 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:36:44.269620 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e06510ae-29a8-4022-941a-ee6888cdbd20 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-volume_attachments/9a520123-d4d7-4bf7-a602-2061fd778e2c" status: 202 len: 0 microversion: 2.1 time: 0.306409 Sep 19 17:36:44.270345 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 539/1087] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:36:43 2022] DELETE /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-volume_attachments/9a520123-d4d7-4bf7-a602-2061fd778e2c => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:36:44.279145 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b005c7b5-3d60-4ebf-9042-97a5009e214d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:44.283424 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b005c7b5-3d60-4ebf-9042-97a5009e214d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:44.289818 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b005c7b5-3d60-4ebf-9042-97a5009e214d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:44.290048 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b005c7b5-3d60-4ebf-9042-97a5009e214d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:44.290578 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b005c7b5-3d60-4ebf-9042-97a5009e214d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:44.291299 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b005c7b5-3d60-4ebf-9042-97a5009e214d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:44.291790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b005c7b5-3d60-4ebf-9042-97a5009e214d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:44.292230 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b005c7b5-3d60-4ebf-9042-97a5009e214d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:44.325380 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b005c7b5-3d60-4ebf-9042-97a5009e214d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050431 Sep 19 17:36:44.325954 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 549/1088] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:36:44 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:36:45.339648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0bb06e7e-f8e6-465f-95bd-8463205534c2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:45.342782 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0bb06e7e-f8e6-465f-95bd-8463205534c2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:45.351362 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bb06e7e-f8e6-465f-95bd-8463205534c2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:45.352557 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bb06e7e-f8e6-465f-95bd-8463205534c2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:45.356447 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bb06e7e-f8e6-465f-95bd-8463205534c2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:45.356447 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bb06e7e-f8e6-465f-95bd-8463205534c2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:45.356447 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bb06e7e-f8e6-465f-95bd-8463205534c2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:45.356447 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bb06e7e-f8e6-465f-95bd-8463205534c2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:45.386881 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0bb06e7e-f8e6-465f-95bd-8463205534c2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051919 Sep 19 17:36:45.387374 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 540/1089] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:36:45 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:36:46.398850 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c62ef1bf-8d7a-4ecb-85c1-39d33b4a016c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:46.401015 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c62ef1bf-8d7a-4ecb-85c1-39d33b4a016c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:46.407943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62ef1bf-8d7a-4ecb-85c1-39d33b4a016c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:46.407943 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62ef1bf-8d7a-4ecb-85c1-39d33b4a016c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:46.408398 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62ef1bf-8d7a-4ecb-85c1-39d33b4a016c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:46.409090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62ef1bf-8d7a-4ecb-85c1-39d33b4a016c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:46.409542 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62ef1bf-8d7a-4ecb-85c1-39d33b4a016c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:46.409965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62ef1bf-8d7a-4ecb-85c1-39d33b4a016c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:46.445711 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c62ef1bf-8d7a-4ecb-85c1-39d33b4a016c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051033 Sep 19 17:36:46.446741 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 550/1090] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:36:46 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 17:36:46.523043 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea749f81-3549-4fef-bd3a-4a51d924f3a8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:46.523597 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea749f81-3549-4fef-bd3a-4a51d924f3a8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:46.530875 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea749f81-3549-4fef-bd3a-4a51d924f3a8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:46.531351 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea749f81-3549-4fef-bd3a-4a51d924f3a8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:46.531953 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea749f81-3549-4fef-bd3a-4a51d924f3a8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:46.532529 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea749f81-3549-4fef-bd3a-4a51d924f3a8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:46.533078 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea749f81-3549-4fef-bd3a-4a51d924f3a8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:46.533500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea749f81-3549-4fef-bd3a-4a51d924f3a8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:46.560876 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea749f81-3549-4fef-bd3a-4a51d924f3a8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:36:46.872481 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea749f81-3549-4fef-bd3a-4a51d924f3a8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 204 len: 0 microversion: 2.1 time: 0.353137 Sep 19 17:36:46.883926 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 541/1091] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:36:46 2022] DELETE /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:36:46.889068 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0123049a-d535-4921-af96-5c24ba6349c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:46.893008 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0123049a-d535-4921-af96-5c24ba6349c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:46.906017 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0123049a-d535-4921-af96-5c24ba6349c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:46.910500 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0123049a-d535-4921-af96-5c24ba6349c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:46.910500 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0123049a-d535-4921-af96-5c24ba6349c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:46.910500 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0123049a-d535-4921-af96-5c24ba6349c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:46.910500 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0123049a-d535-4921-af96-5c24ba6349c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:46.911043 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0123049a-d535-4921-af96-5c24ba6349c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:47.062171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0123049a-d535-4921-af96-5c24ba6349c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:36:47.071312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0123049a-d535-4921-af96-5c24ba6349c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1677 microversion: 2.1 time: 0.187479 Sep 19 17:36:47.071928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 551/1092] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:46 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:36:48.103544 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20d803d3-1185-4d22-9379-7a4176e17e93 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:48.104964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-20d803d3-1185-4d22-9379-7a4176e17e93 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:48.111654 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20d803d3-1185-4d22-9379-7a4176e17e93 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:48.112249 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20d803d3-1185-4d22-9379-7a4176e17e93 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:48.113364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20d803d3-1185-4d22-9379-7a4176e17e93 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:48.114053 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20d803d3-1185-4d22-9379-7a4176e17e93 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:48.114571 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20d803d3-1185-4d22-9379-7a4176e17e93 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:48.115155 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20d803d3-1185-4d22-9379-7a4176e17e93 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:48.267171 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-20d803d3-1185-4d22-9379-7a4176e17e93 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:36:48.277037 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-20d803d3-1185-4d22-9379-7a4176e17e93 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1677 microversion: 2.1 time: 0.178190 Sep 19 17:36:48.278489 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 542/1093] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:48 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:36:49.306063 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5a55be4-6948-42a9-84d3-0f802200b223 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:49.306681 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5a55be4-6948-42a9-84d3-0f802200b223 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:49.315360 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5a55be4-6948-42a9-84d3-0f802200b223 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:49.316007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5a55be4-6948-42a9-84d3-0f802200b223 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:49.316550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5a55be4-6948-42a9-84d3-0f802200b223 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:49.317500 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5a55be4-6948-42a9-84d3-0f802200b223 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:49.318033 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5a55be4-6948-42a9-84d3-0f802200b223 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:49.318527 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5a55be4-6948-42a9-84d3-0f802200b223 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:49.492876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5a55be4-6948-42a9-84d3-0f802200b223 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:36:49.504981 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5a55be4-6948-42a9-84d3-0f802200b223 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1677 microversion: 2.1 time: 0.203394 Sep 19 17:36:49.505588 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 552/1094] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:49 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:36:50.530641 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74621267-492c-448e-97ec-ca7538d496f2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:50.532519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-74621267-492c-448e-97ec-ca7538d496f2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:50.540000 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74621267-492c-448e-97ec-ca7538d496f2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:50.540505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74621267-492c-448e-97ec-ca7538d496f2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:50.540984 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74621267-492c-448e-97ec-ca7538d496f2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:50.541776 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74621267-492c-448e-97ec-ca7538d496f2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:50.542492 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74621267-492c-448e-97ec-ca7538d496f2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:50.543300 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74621267-492c-448e-97ec-ca7538d496f2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:50.727941 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-74621267-492c-448e-97ec-ca7538d496f2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:36:50.743575 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74621267-492c-448e-97ec-ca7538d496f2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1677 microversion: 2.1 time: 0.217258 Sep 19 17:36:50.763024 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 543/1095] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:50 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:36:51.033560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-223d597d-9fe7-42d8-87dd-1dd4e9e6a273 req-133f2ac6-c7b6-49ae-b57c-e7ca642fe723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a67add5-c558-4f0e-ad79-5b1683cfbee3", "name": "network-vif-deleted", "tag": "3176241b-1c1c-41c5-babe-9aaf4adb08fe"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:36:51.048245 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-223d597d-9fe7-42d8-87dd-1dd4e9e6a273 req-133f2ac6-c7b6-49ae-b57c-e7ca642fe723 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:51.049185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-223d597d-9fe7-42d8-87dd-1dd4e9e6a273 req-133f2ac6-c7b6-49ae-b57c-e7ca642fe723 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:51.051989 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-223d597d-9fe7-42d8-87dd-1dd4e9e6a273 req-133f2ac6-c7b6-49ae-b57c-e7ca642fe723 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:51.073737 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-223d597d-9fe7-42d8-87dd-1dd4e9e6a273 req-133f2ac6-c7b6-49ae-b57c-e7ca642fe723 service nova] Creating event network-vif-deleted:3176241b-1c1c-41c5-babe-9aaf4adb08fe for instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 on hv-cinder-84801 Sep 19 17:36:51.087011 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-223d597d-9fe7-42d8-87dd-1dd4e9e6a273 req-133f2ac6-c7b6-49ae-b57c-e7ca642fe723 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059705 Sep 19 17:36:51.091763 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 553/1096] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:36:51.771041 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:51.771643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:51.778523 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:51.779049 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:51.779609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:51.780270 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:51.780754 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:51.781182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:51.829552 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:51.830408 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:51.835789 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:51.837467 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lazy-loading 'fault' on Instance uuid 3a67add5-c558-4f0e-ad79-5b1683cfbee3 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:36:51.906542 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:36:51.917039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ef143992-ac61-498a-8922-d5aca85557f7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 200 len: 1329 microversion: 2.1 time: 0.150259 Sep 19 17:36:51.919899 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 544/1097] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:51 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 1329 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:36:52.942820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:52.943420 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:52.952542 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:52.953437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:52.953544 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:52.954168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:52.954626 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:52.955112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:52.970893 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 HTTP/1.1 Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:36:52.972736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:36:52.974181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '3a67add5-c558-4f0e-ad79-5b1683cfbee3'} Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:36:52.974968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:36:52.976330 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:36:52.977467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:36:52.977467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d481dc9-1245-44e3-8cf2-41ebef290e27 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 404 len: 111 microversion: 2.1 time: 0.036761 Sep 19 17:36:52.977467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 554/1098] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:52 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:36:52.985617 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85e54ce9-1b39-42ca-998e-29b2131cadaf tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '.version_select at 0x7fd4d6226550>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:53.128962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85e54ce9-1b39-42ca-998e-29b2131cadaf tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-4746610" status: 202 len: 0 microversion: 2.1 time: 0.148351 Sep 19 17:36:53.129553 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 545/1099] 10.222.0.61 () {58 vars in 1212 bytes} [Mon Sep 19 17:36:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-4746610 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:36:54.474895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a363a398-fa26-40ef-8785-75bd2e932d95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: .version_select at 0x7fd4d60aa1f0>, body: {"keypair": {"name": "tempest-keypair-1209670566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOn77XaJ4wopAVLBWqEBE8o5JEOuaVr299XACYh4hQTiTUb7ergeOhaUJoNhW3XH+6MFSVyabDyuzWjyKTiJb+NbOC+u11Ztxwsc6mIDtCsIqY3eTz+yhgTmHlJG3otBg=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:36:54.497359 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-a363a398-fa26-40ef-8785-75bd2e932d95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:36:54.504128 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-a363a398-fa26-40ef-8785-75bd2e932d95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for user a8e4233c03174fa18deb6baad431543b and project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:36:54.648933 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a363a398-fa26-40ef-8785-75bd2e932d95 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181093 Sep 19 17:36:54.652433 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 555/1100] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Sep 19 17:36:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:36:57.883548 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1679435854", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee3141f2-3b76-40de-a3df-4fd096ef3d26"}], "security_groups": [{"name": "tempest-securitygroup--1645448021"}], "key_name": "tempest-keypair-1209670566", "user_data": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:36:58.020512 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e2a27744-9bd6-428c-ae1a-df7c55d28e4b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Action: 'create', calling method: .version_select at 0x7fd4d60d59d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1139086849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRozkj1q7EwDnvHqylQ7wHq15xcOQR4N0Da/X7oE8mMq0pRTMgxKQ0E10tkJJJKu+XTpkbKvUonduS0nC+aPr0xZklb9GFiQ8RbIQP86hcorXoGhXY63S/NkLVxGUR50Q=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:36:58.023029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] validate_networks() for [('ee3141f2-3b76-40de-a3df-4fd096ef3d26', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:36:58.042830 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-e2a27744-9bd6-428c-ae1a-df7c55d28e4b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Getting quotas for project 3fa7a842679b460f87e34a84e7d12c5f. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:36:58.049067 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-e2a27744-9bd6-428c-ae1a-df7c55d28e4b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Getting quotas for user a695d9e178414ba294fc30fe12edf7aa and project 3fa7a842679b460f87e34a84e7d12c5f. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:36:58.131641 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e2a27744-9bd6-428c-ae1a-df7c55d28e4b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.325786 Sep 19 17:36:58.132359 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 546/1101] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Sep 19 17:36:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:36:58.499593 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:36:58.500187 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:36:58.501005 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:36:58.501473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:36:58.501916 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:36:58.512202 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:58.514949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:58.514949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:58.514949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:58.514949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:58.515414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:58.533499 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:36:58.538256 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for user a8e4233c03174fa18deb6baad431543b and project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:36:58.549853 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:36:58.552373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:36:58.738552 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fce499d0-6d22-4211-8e9d-bbbebf21bca3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.859866 Sep 19 17:36:58.740602 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 556/1102] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:36:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 17:36:58.755509 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-23adbdf5-24eb-43ca-8956-12e29efc7986 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:58.756487 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-23adbdf5-24eb-43ca-8956-12e29efc7986 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:58.821969 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-23adbdf5-24eb-43ca-8956-12e29efc7986 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:36:58.829160 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-23adbdf5-24eb-43ca-8956-12e29efc7986 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1242 microversion: 2.1 time: 0.080645 Sep 19 17:36:58.829909 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 547/1103] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:58 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:36:59.853078 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f6585e45-4ff6-4731-b4dc-7949ece83bd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:36:59.853695 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f6585e45-4ff6-4731-b4dc-7949ece83bd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:36:59.860771 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6585e45-4ff6-4731-b4dc-7949ece83bd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:59.861296 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6585e45-4ff6-4731-b4dc-7949ece83bd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:59.861732 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6585e45-4ff6-4731-b4dc-7949ece83bd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:59.862426 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6585e45-4ff6-4731-b4dc-7949ece83bd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:36:59.862883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6585e45-4ff6-4731-b4dc-7949ece83bd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:36:59.863309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6585e45-4ff6-4731-b4dc-7949ece83bd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:36:59.942443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f6585e45-4ff6-4731-b4dc-7949ece83bd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:36:59.950210 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f6585e45-4ff6-4731-b4dc-7949ece83bd0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1246 microversion: 2.1 time: 0.101235 Sep 19 17:36:59.950777 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 557/1104] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:36:59 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:00.973317 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36084b9f-bffe-4aca-a6fc-6d5f1974146a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:00.974867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-36084b9f-bffe-4aca-a6fc-6d5f1974146a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:00.988715 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36084b9f-bffe-4aca-a6fc-6d5f1974146a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:00.989286 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36084b9f-bffe-4aca-a6fc-6d5f1974146a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:00.989741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36084b9f-bffe-4aca-a6fc-6d5f1974146a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:00.994908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36084b9f-bffe-4aca-a6fc-6d5f1974146a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:00.995797 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36084b9f-bffe-4aca-a6fc-6d5f1974146a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:00.997011 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36084b9f-bffe-4aca-a6fc-6d5f1974146a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:01.078984 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-36084b9f-bffe-4aca-a6fc-6d5f1974146a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:01.087633 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36084b9f-bffe-4aca-a6fc-6d5f1974146a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1294 microversion: 2.1 time: 0.118334 Sep 19 17:37:01.088315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 548/1105] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:00 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:02.110902 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-33bf5305-b550-439c-b849-c9a968471d58 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:02.112999 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-33bf5305-b550-439c-b849-c9a968471d58 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:02.120023 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33bf5305-b550-439c-b849-c9a968471d58 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:02.134056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33bf5305-b550-439c-b849-c9a968471d58 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:02.134788 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33bf5305-b550-439c-b849-c9a968471d58 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:02.135790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33bf5305-b550-439c-b849-c9a968471d58 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:02.136437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33bf5305-b550-439c-b849-c9a968471d58 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:02.137047 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33bf5305-b550-439c-b849-c9a968471d58 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:02.220508 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-33bf5305-b550-439c-b849-c9a968471d58 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:02.231098 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-33bf5305-b550-439c-b849-c9a968471d58 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1300 microversion: 2.1 time: 0.123862 Sep 19 17:37:02.240288 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 558/1106] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:02 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:03.255047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aee75fe2-5326-4f8a-8e8e-ac6285d7e9a7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:03.255972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aee75fe2-5326-4f8a-8e8e-ac6285d7e9a7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:03.263529 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aee75fe2-5326-4f8a-8e8e-ac6285d7e9a7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:03.264168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aee75fe2-5326-4f8a-8e8e-ac6285d7e9a7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:03.269226 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aee75fe2-5326-4f8a-8e8e-ac6285d7e9a7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:03.269226 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aee75fe2-5326-4f8a-8e8e-ac6285d7e9a7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:03.269226 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aee75fe2-5326-4f8a-8e8e-ac6285d7e9a7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:03.269226 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aee75fe2-5326-4f8a-8e8e-ac6285d7e9a7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:03.413095 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-aee75fe2-5326-4f8a-8e8e-ac6285d7e9a7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:03.424303 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aee75fe2-5326-4f8a-8e8e-ac6285d7e9a7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.171954 Sep 19 17:37:03.424303 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 549/1107] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:03 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:03.631343 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5887b995-caff-4d65-93b8-b1d9b31e8533 req-e258d976-7723-4828-8a71-28b37436df90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5770044-beb3-4748-b53c-c2487feab9f8", "tag": "065f60d9-1405-4ef7-a649-7c8d93430d74"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:37:03.643165 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5887b995-caff-4d65-93b8-b1d9b31e8533 req-e258d976-7723-4828-8a71-28b37436df90 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:03.644163 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5887b995-caff-4d65-93b8-b1d9b31e8533 req-e258d976-7723-4828-8a71-28b37436df90 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:03.644641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5887b995-caff-4d65-93b8-b1d9b31e8533 req-e258d976-7723-4828-8a71-28b37436df90 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:03.655803 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-5887b995-caff-4d65-93b8-b1d9b31e8533 req-e258d976-7723-4828-8a71-28b37436df90 service nova] Creating event network-changed:065f60d9-1405-4ef7-a649-7c8d93430d74 for instance c5770044-beb3-4748-b53c-c2487feab9f8 on hv-cinder-84801 Sep 19 17:37:03.661537 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5887b995-caff-4d65-93b8-b1d9b31e8533 req-e258d976-7723-4828-8a71-28b37436df90 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034013 Sep 19 17:37:03.662380 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 559/1108] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:37:04.446627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-13761412-6ccd-4d8e-a59d-a5493a45c522 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:04.447303 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-13761412-6ccd-4d8e-a59d-a5493a45c522 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:04.454527 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13761412-6ccd-4d8e-a59d-a5493a45c522 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:04.455039 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13761412-6ccd-4d8e-a59d-a5493a45c522 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:04.455483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13761412-6ccd-4d8e-a59d-a5493a45c522 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:04.456755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13761412-6ccd-4d8e-a59d-a5493a45c522 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:04.457215 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13761412-6ccd-4d8e-a59d-a5493a45c522 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:04.457645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13761412-6ccd-4d8e-a59d-a5493a45c522 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:04.602129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-13761412-6ccd-4d8e-a59d-a5493a45c522 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:04.605711 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:04.610228 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-13761412-6ccd-4d8e-a59d-a5493a45c522 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.167717 Sep 19 17:37:04.610801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 550/1109] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:04 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:05.633811 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9e76c14d-8639-4341-9476-2ec258ce75c3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:05.634689 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9e76c14d-8639-4341-9476-2ec258ce75c3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:05.641062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e76c14d-8639-4341-9476-2ec258ce75c3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:05.641553 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e76c14d-8639-4341-9476-2ec258ce75c3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:05.642000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e76c14d-8639-4341-9476-2ec258ce75c3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:05.642740 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e76c14d-8639-4341-9476-2ec258ce75c3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:05.643241 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e76c14d-8639-4341-9476-2ec258ce75c3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:05.643685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e76c14d-8639-4341-9476-2ec258ce75c3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:05.783034 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9e76c14d-8639-4341-9476-2ec258ce75c3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:05.791547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9e76c14d-8639-4341-9476-2ec258ce75c3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.161973 Sep 19 17:37:05.794761 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 560/1110] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:05 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:06.814566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd3b16c0-9b23-49c2-9ae5-cf134fda56fc tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:06.815178 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd3b16c0-9b23-49c2-9ae5-cf134fda56fc tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:06.823096 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd3b16c0-9b23-49c2-9ae5-cf134fda56fc tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:06.823587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd3b16c0-9b23-49c2-9ae5-cf134fda56fc tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:06.830109 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd3b16c0-9b23-49c2-9ae5-cf134fda56fc tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:06.830109 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd3b16c0-9b23-49c2-9ae5-cf134fda56fc tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:06.830109 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd3b16c0-9b23-49c2-9ae5-cf134fda56fc tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:06.830109 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd3b16c0-9b23-49c2-9ae5-cf134fda56fc tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:06.965412 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd3b16c0-9b23-49c2-9ae5-cf134fda56fc tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:06.977244 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd3b16c0-9b23-49c2-9ae5-cf134fda56fc tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.166489 Sep 19 17:37:06.977851 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 551/1111] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:06 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:08.001039 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f21880ac-ad4b-4f27-bad9-3b7b0c6163c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:08.001615 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f21880ac-ad4b-4f27-bad9-3b7b0c6163c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:08.008634 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f21880ac-ad4b-4f27-bad9-3b7b0c6163c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:08.009382 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f21880ac-ad4b-4f27-bad9-3b7b0c6163c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:08.009818 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f21880ac-ad4b-4f27-bad9-3b7b0c6163c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:08.010507 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f21880ac-ad4b-4f27-bad9-3b7b0c6163c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:08.010960 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f21880ac-ad4b-4f27-bad9-3b7b0c6163c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:08.011384 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f21880ac-ad4b-4f27-bad9-3b7b0c6163c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:08.147627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f21880ac-ad4b-4f27-bad9-3b7b0c6163c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:08.155816 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f21880ac-ad4b-4f27-bad9-3b7b0c6163c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.158640 Sep 19 17:37:08.156404 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 561/1112] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:07 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:09.179774 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86937c48-3020-4472-8ff2-19169812d9dd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:09.180386 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86937c48-3020-4472-8ff2-19169812d9dd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:09.182755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:09.183544 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:09.188190 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86937c48-3020-4472-8ff2-19169812d9dd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:09.188670 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86937c48-3020-4472-8ff2-19169812d9dd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:09.189101 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86937c48-3020-4472-8ff2-19169812d9dd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:09.189791 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86937c48-3020-4472-8ff2-19169812d9dd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:09.194261 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86937c48-3020-4472-8ff2-19169812d9dd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:09.194261 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86937c48-3020-4472-8ff2-19169812d9dd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:09.326427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-86937c48-3020-4472-8ff2-19169812d9dd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:09.335812 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86937c48-3020-4472-8ff2-19169812d9dd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.160510 Sep 19 17:37:09.336628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 552/1113] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:09 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:10.364659 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a26a1a2-1791-470d-9247-e546082faaf4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:10.365830 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a26a1a2-1791-470d-9247-e546082faaf4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:10.367778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:10.368464 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:10.373839 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a26a1a2-1791-470d-9247-e546082faaf4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:10.376690 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a26a1a2-1791-470d-9247-e546082faaf4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:10.376690 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a26a1a2-1791-470d-9247-e546082faaf4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:10.376690 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a26a1a2-1791-470d-9247-e546082faaf4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:10.376690 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a26a1a2-1791-470d-9247-e546082faaf4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:10.377274 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a26a1a2-1791-470d-9247-e546082faaf4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:10.511842 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1a26a1a2-1791-470d-9247-e546082faaf4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:10.519475 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a26a1a2-1791-470d-9247-e546082faaf4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.158765 Sep 19 17:37:10.520075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 562/1114] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:10 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:11.543008 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5991fec-5332-4935-a3d2-b20d3a36245b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:11.543729 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5991fec-5332-4935-a3d2-b20d3a36245b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:11.550129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5991fec-5332-4935-a3d2-b20d3a36245b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:11.550626 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5991fec-5332-4935-a3d2-b20d3a36245b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:11.551068 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5991fec-5332-4935-a3d2-b20d3a36245b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:11.551800 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5991fec-5332-4935-a3d2-b20d3a36245b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:11.552266 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5991fec-5332-4935-a3d2-b20d3a36245b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:11.552702 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5991fec-5332-4935-a3d2-b20d3a36245b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:11.683351 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5991fec-5332-4935-a3d2-b20d3a36245b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:11.694543 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5991fec-5332-4935-a3d2-b20d3a36245b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.155700 Sep 19 17:37:11.698801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 553/1115] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:11 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:12.718321 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b53bb024-9e35-4adc-a084-9cd46bbd60d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:12.719126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b53bb024-9e35-4adc-a084-9cd46bbd60d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:12.724628 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:12.728625 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53bb024-9e35-4adc-a084-9cd46bbd60d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:12.729124 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53bb024-9e35-4adc-a084-9cd46bbd60d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:12.729571 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53bb024-9e35-4adc-a084-9cd46bbd60d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:12.730284 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53bb024-9e35-4adc-a084-9cd46bbd60d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:12.730746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53bb024-9e35-4adc-a084-9cd46bbd60d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:12.731303 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53bb024-9e35-4adc-a084-9cd46bbd60d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:12.734217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=89 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:12.871823 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b53bb024-9e35-4adc-a084-9cd46bbd60d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:12.878577 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b53bb024-9e35-4adc-a084-9cd46bbd60d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.165060 Sep 19 17:37:12.879151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 563/1116] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:12 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:13.901317 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d105941a-02f1-47fa-aff3-d3a5f19c9cd9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:13.901936 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d105941a-02f1-47fa-aff3-d3a5f19c9cd9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:13.909210 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d105941a-02f1-47fa-aff3-d3a5f19c9cd9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:13.909704 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d105941a-02f1-47fa-aff3-d3a5f19c9cd9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:13.910149 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d105941a-02f1-47fa-aff3-d3a5f19c9cd9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:13.910860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d105941a-02f1-47fa-aff3-d3a5f19c9cd9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:13.911319 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d105941a-02f1-47fa-aff3-d3a5f19c9cd9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:13.911778 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d105941a-02f1-47fa-aff3-d3a5f19c9cd9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:14.055830 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d105941a-02f1-47fa-aff3-d3a5f19c9cd9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:14.063755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d105941a-02f1-47fa-aff3-d3a5f19c9cd9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.166217 Sep 19 17:37:14.064362 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 554/1117] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:13 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:15.088628 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c3134cf5-c7c6-4797-b0b6-8c2ed0023ed2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:15.089156 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c3134cf5-c7c6-4797-b0b6-8c2ed0023ed2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:15.095593 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3134cf5-c7c6-4797-b0b6-8c2ed0023ed2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:15.096112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3134cf5-c7c6-4797-b0b6-8c2ed0023ed2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:15.096558 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3134cf5-c7c6-4797-b0b6-8c2ed0023ed2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:15.097257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3134cf5-c7c6-4797-b0b6-8c2ed0023ed2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:15.097718 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3134cf5-c7c6-4797-b0b6-8c2ed0023ed2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:15.098151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3134cf5-c7c6-4797-b0b6-8c2ed0023ed2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:15.232989 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c3134cf5-c7c6-4797-b0b6-8c2ed0023ed2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:15.241665 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c3134cf5-c7c6-4797-b0b6-8c2ed0023ed2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.156935 Sep 19 17:37:15.242247 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 564/1118] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:15 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:16.264603 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-831b7fa2-3e1b-42b1-9025-1f948c744b5d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:16.265213 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-831b7fa2-3e1b-42b1-9025-1f948c744b5d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:16.271812 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-831b7fa2-3e1b-42b1-9025-1f948c744b5d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:16.272291 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-831b7fa2-3e1b-42b1-9025-1f948c744b5d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:16.272726 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-831b7fa2-3e1b-42b1-9025-1f948c744b5d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:16.273411 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-831b7fa2-3e1b-42b1-9025-1f948c744b5d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:16.273861 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-831b7fa2-3e1b-42b1-9025-1f948c744b5d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:16.274289 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-831b7fa2-3e1b-42b1-9025-1f948c744b5d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:16.414799 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-831b7fa2-3e1b-42b1-9025-1f948c744b5d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:16.422609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-831b7fa2-3e1b-42b1-9025-1f948c744b5d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.161813 Sep 19 17:37:16.423174 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 555/1119] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:16 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:17.446550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-abdc362d-2119-4f47-b6a8-a2c020823e1e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:17.447188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-abdc362d-2119-4f47-b6a8-a2c020823e1e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:17.453714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdc362d-2119-4f47-b6a8-a2c020823e1e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:17.454190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdc362d-2119-4f47-b6a8-a2c020823e1e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:17.454626 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdc362d-2119-4f47-b6a8-a2c020823e1e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:17.455317 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdc362d-2119-4f47-b6a8-a2c020823e1e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:17.455826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdc362d-2119-4f47-b6a8-a2c020823e1e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:17.456255 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdc362d-2119-4f47-b6a8-a2c020823e1e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:17.589895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-abdc362d-2119-4f47-b6a8-a2c020823e1e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:17.597705 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-abdc362d-2119-4f47-b6a8-a2c020823e1e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.155595 Sep 19 17:37:17.598288 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 565/1120] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:17 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:37:18.519721 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-96c2986e-44c4-401a-a896-8e3747c8bbff req-d2d619ed-54c7-447a-8cbd-13e844745f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5770044-beb3-4748-b53c-c2487feab9f8", "name": "network-vif-plugged", "status": "completed", "tag": "065f60d9-1405-4ef7-a649-7c8d93430d74"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:37:18.529730 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-96c2986e-44c4-401a-a896-8e3747c8bbff req-d2d619ed-54c7-447a-8cbd-13e844745f95 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:18.530465 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-96c2986e-44c4-401a-a896-8e3747c8bbff req-d2d619ed-54c7-447a-8cbd-13e844745f95 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:18.530748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-96c2986e-44c4-401a-a896-8e3747c8bbff req-d2d619ed-54c7-447a-8cbd-13e844745f95 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:18.541968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-96c2986e-44c4-401a-a896-8e3747c8bbff req-d2d619ed-54c7-447a-8cbd-13e844745f95 service nova] Creating event network-vif-plugged:065f60d9-1405-4ef7-a649-7c8d93430d74 for instance c5770044-beb3-4748-b53c-c2487feab9f8 on hv-cinder-84801 Sep 19 17:37:18.546958 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-96c2986e-44c4-401a-a896-8e3747c8bbff req-d2d619ed-54c7-447a-8cbd-13e844745f95 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031012 Sep 19 17:37:18.547547 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 556/1121] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:37:18.621185 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2589fbd-5c95-47f9-a943-b7466ea4b710 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:18.621801 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a2589fbd-5c95-47f9-a943-b7466ea4b710 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:18.628200 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2589fbd-5c95-47f9-a943-b7466ea4b710 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:18.628686 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2589fbd-5c95-47f9-a943-b7466ea4b710 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:18.629127 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2589fbd-5c95-47f9-a943-b7466ea4b710 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:18.629820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2589fbd-5c95-47f9-a943-b7466ea4b710 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:18.630278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2589fbd-5c95-47f9-a943-b7466ea4b710 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:18.631288 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2589fbd-5c95-47f9-a943-b7466ea4b710 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:18.765940 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a2589fbd-5c95-47f9-a943-b7466ea4b710 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:18.774764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a2589fbd-5c95-47f9-a943-b7466ea4b710 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.157398 Sep 19 17:37:18.775717 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 566/1122] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:18 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:19.800008 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2544cfec-e930-4ccb-bd88-f9082c8c3a2e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:19.800629 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2544cfec-e930-4ccb-bd88-f9082c8c3a2e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:19.807068 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2544cfec-e930-4ccb-bd88-f9082c8c3a2e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:19.807558 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2544cfec-e930-4ccb-bd88-f9082c8c3a2e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:19.808025 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2544cfec-e930-4ccb-bd88-f9082c8c3a2e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:19.808713 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2544cfec-e930-4ccb-bd88-f9082c8c3a2e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:19.809177 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2544cfec-e930-4ccb-bd88-f9082c8c3a2e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:19.809608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2544cfec-e930-4ccb-bd88-f9082c8c3a2e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:19.945705 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2544cfec-e930-4ccb-bd88-f9082c8c3a2e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:19.954044 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2544cfec-e930-4ccb-bd88-f9082c8c3a2e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.158901 Sep 19 17:37:19.954622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 557/1123] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:19 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:20.978298 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51d63d97-3d8e-42b1-9d6d-9d2060de6c76 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:20.978915 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-51d63d97-3d8e-42b1-9d6d-9d2060de6c76 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:20.985337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d63d97-3d8e-42b1-9d6d-9d2060de6c76 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:20.985827 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d63d97-3d8e-42b1-9d6d-9d2060de6c76 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:20.986270 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d63d97-3d8e-42b1-9d6d-9d2060de6c76 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:20.986964 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d63d97-3d8e-42b1-9d6d-9d2060de6c76 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:20.987423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d63d97-3d8e-42b1-9d6d-9d2060de6c76 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:20.987882 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d63d97-3d8e-42b1-9d6d-9d2060de6c76 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:21.115448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-51d63d97-3d8e-42b1-9d6d-9d2060de6c76 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:21.123146 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-51d63d97-3d8e-42b1-9d6d-9d2060de6c76 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1368 microversion: 2.1 time: 0.149312 Sep 19 17:37:21.123743 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 567/1124] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:20 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:22.199788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ab46f53-900f-476b-b7ac-d107e78c2ee2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:22.200446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ab46f53-900f-476b-b7ac-d107e78c2ee2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:22.206725 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab46f53-900f-476b-b7ac-d107e78c2ee2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:22.207211 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab46f53-900f-476b-b7ac-d107e78c2ee2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:22.207647 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab46f53-900f-476b-b7ac-d107e78c2ee2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:22.209080 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab46f53-900f-476b-b7ac-d107e78c2ee2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:22.209438 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab46f53-900f-476b-b7ac-d107e78c2ee2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:22.209867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab46f53-900f-476b-b7ac-d107e78c2ee2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:22.348769 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ab46f53-900f-476b-b7ac-d107e78c2ee2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:22.357351 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ab46f53-900f-476b-b7ac-d107e78c2ee2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1558 microversion: 2.1 time: 0.214136 Sep 19 17:37:22.357938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 558/1125] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:22 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:37:22.380636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d4b1a22-52f7-465e-b83d-4378fc84efb1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:22.381270 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d4b1a22-52f7-465e-b83d-4378fc84efb1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:22.388285 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d4b1a22-52f7-465e-b83d-4378fc84efb1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:22.388775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d4b1a22-52f7-465e-b83d-4378fc84efb1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:22.389222 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d4b1a22-52f7-465e-b83d-4378fc84efb1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:22.389968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d4b1a22-52f7-465e-b83d-4378fc84efb1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:22.390427 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d4b1a22-52f7-465e-b83d-4378fc84efb1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:22.391258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d4b1a22-52f7-465e-b83d-4378fc84efb1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:22.473804 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d4b1a22-52f7-465e-b83d-4378fc84efb1 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097306 Sep 19 17:37:22.475339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 568/1126] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Sep 19 17:37:22 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:37:23.737093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d945b41d-5826-479b-80da-6a68d6708d60 req-47a3f43d-0328-4d52-8df6-b93e31813de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5770044-beb3-4748-b53c-c2487feab9f8", "tag": "065f60d9-1405-4ef7-a649-7c8d93430d74"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:37:23.748050 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d945b41d-5826-479b-80da-6a68d6708d60 req-47a3f43d-0328-4d52-8df6-b93e31813de5 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:23.748602 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d945b41d-5826-479b-80da-6a68d6708d60 req-47a3f43d-0328-4d52-8df6-b93e31813de5 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:23.749348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d945b41d-5826-479b-80da-6a68d6708d60 req-47a3f43d-0328-4d52-8df6-b93e31813de5 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:23.763847 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d945b41d-5826-479b-80da-6a68d6708d60 req-47a3f43d-0328-4d52-8df6-b93e31813de5 service nova] Creating event network-changed:065f60d9-1405-4ef7-a649-7c8d93430d74 for instance c5770044-beb3-4748-b53c-c2487feab9f8 on hv-cinder-84801 Sep 19 17:37:23.768973 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d945b41d-5826-479b-80da-6a68d6708d60 req-47a3f43d-0328-4d52-8df6-b93e31813de5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035640 Sep 19 17:37:23.774008 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 559/1127] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:37:35.901186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=11 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:35.901963 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=33 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:35.905883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-708761963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1139086849", "security_groups": [{"name": "tempest-secgroup-smoke-1369752678"}], "block_device_mapping_v2": [{"uuid": "92dede58-5c14-4bee-9363-207643830d2b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1590abdf-b953-4897-85f6-bffe0b292150"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:37:36.021822 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] validate_networks() for [('1590abdf-b953-4897-85f6-bffe0b292150', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:37:36.415262 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:37:36.415782 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:37:36.416357 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:37:36.416835 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:37:36.417526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:37:36.428590 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:36.430110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:36.430110 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:36.430569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:36.431097 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:36.431654 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:36.449636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Getting quotas for project 3fa7a842679b460f87e34a84e7d12c5f. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:37:36.453639 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Getting quotas for user a695d9e178414ba294fc30fe12edf7aa and project 3fa7a842679b460f87e34a84e7d12c5f. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:37:36.516210 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:37:36.518316 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92dede58-5c14-4bee-9363-207643830d2b',volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:37:36.985733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-08a9b257-457a-404f-8c2a-927e1620a572 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.085781 Sep 19 17:37:36.986676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 569/1128] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:37:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:37:36.996061 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=15 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:36.996808 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=46 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:37.000806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5391ad5c-c636-4076-961f-d223ee3e4e71 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:37.001523 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5391ad5c-c636-4076-961f-d223ee3e4e71 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:37.058648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5391ad5c-c636-4076-961f-d223ee3e4e71 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:37.067196 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5391ad5c-c636-4076-961f-d223ee3e4e71 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1094 microversion: 2.1 time: 0.071082 Sep 19 17:37:37.067196 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 560/1129] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:36 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:38.089671 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cb5baadc-1ac2-4ef0-a415-5687f729cffb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:38.090312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cb5baadc-1ac2-4ef0-a415-5687f729cffb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:38.096872 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb5baadc-1ac2-4ef0-a415-5687f729cffb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:38.097354 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb5baadc-1ac2-4ef0-a415-5687f729cffb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:38.097784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb5baadc-1ac2-4ef0-a415-5687f729cffb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:38.098477 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb5baadc-1ac2-4ef0-a415-5687f729cffb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:38.099669 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb5baadc-1ac2-4ef0-a415-5687f729cffb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:38.100152 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb5baadc-1ac2-4ef0-a415-5687f729cffb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:38.168620 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-cb5baadc-1ac2-4ef0-a415-5687f729cffb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:38.175923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cb5baadc-1ac2-4ef0-a415-5687f729cffb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1144 microversion: 2.1 time: 0.090170 Sep 19 17:37:38.176492 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 570/1130] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:38 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:39.198929 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f6bd39f-bf95-40d5-870a-e163b1963435 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:39.199634 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f6bd39f-bf95-40d5-870a-e163b1963435 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:39.209630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6bd39f-bf95-40d5-870a-e163b1963435 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:39.210232 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6bd39f-bf95-40d5-870a-e163b1963435 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:39.210756 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6bd39f-bf95-40d5-870a-e163b1963435 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:39.211570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6bd39f-bf95-40d5-870a-e163b1963435 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:39.212227 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6bd39f-bf95-40d5-870a-e163b1963435 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:39.212790 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6bd39f-bf95-40d5-870a-e163b1963435 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:39.279786 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f6bd39f-bf95-40d5-870a-e163b1963435 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:39.289094 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f6bd39f-bf95-40d5-870a-e163b1963435 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1192 microversion: 2.1 time: 0.094406 Sep 19 17:37:39.289892 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 561/1131] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:39 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:40.312926 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e32c77b6-adb9-4f97-99d2-39bae0980b59 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:40.313534 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e32c77b6-adb9-4f97-99d2-39bae0980b59 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:40.320573 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e32c77b6-adb9-4f97-99d2-39bae0980b59 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:40.327872 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e32c77b6-adb9-4f97-99d2-39bae0980b59 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:40.327872 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e32c77b6-adb9-4f97-99d2-39bae0980b59 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:40.327872 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e32c77b6-adb9-4f97-99d2-39bae0980b59 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:40.327872 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e32c77b6-adb9-4f97-99d2-39bae0980b59 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:40.328558 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e32c77b6-adb9-4f97-99d2-39bae0980b59 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:40.488754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e32c77b6-adb9-4f97-99d2-39bae0980b59 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:40.498246 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e32c77b6-adb9-4f97-99d2-39bae0980b59 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1278 microversion: 2.1 time: 0.189148 Sep 19 17:37:40.498834 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 571/1132] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:40 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:41.221242 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-711af7b9-03fb-4a4f-8169-c736a35cf4c2 req-3a41474a-27dd-4f13-95ba-e668e5e3afe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf0413e-fde3-4cb9-bed3-1dd053a94609", "tag": "ceaaa721-b6be-4326-b3ea-f412d7f7f544"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:37:41.234596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-711af7b9-03fb-4a4f-8169-c736a35cf4c2 req-3a41474a-27dd-4f13-95ba-e668e5e3afe6 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:41.235231 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-711af7b9-03fb-4a4f-8169-c736a35cf4c2 req-3a41474a-27dd-4f13-95ba-e668e5e3afe6 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:41.235817 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-711af7b9-03fb-4a4f-8169-c736a35cf4c2 req-3a41474a-27dd-4f13-95ba-e668e5e3afe6 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:41.250187 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-711af7b9-03fb-4a4f-8169-c736a35cf4c2 req-3a41474a-27dd-4f13-95ba-e668e5e3afe6 service nova] Creating event network-changed:ceaaa721-b6be-4326-b3ea-f412d7f7f544 for instance faf0413e-fde3-4cb9-bed3-1dd053a94609 on hv-cinder-84801 Sep 19 17:37:41.256221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-711af7b9-03fb-4a4f-8169-c736a35cf4c2 req-3a41474a-27dd-4f13-95ba-e668e5e3afe6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037985 Sep 19 17:37:41.257063 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 562/1133] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:37:41.533889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c7c48ef-7d05-433f-ac30-7bd1c748d1fd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:41.536239 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c7c48ef-7d05-433f-ac30-7bd1c748d1fd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:41.548204 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7c48ef-7d05-433f-ac30-7bd1c748d1fd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:41.549483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7c48ef-7d05-433f-ac30-7bd1c748d1fd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:41.550584 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7c48ef-7d05-433f-ac30-7bd1c748d1fd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:41.552271 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7c48ef-7d05-433f-ac30-7bd1c748d1fd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:41.553443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7c48ef-7d05-433f-ac30-7bd1c748d1fd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:41.555440 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7c48ef-7d05-433f-ac30-7bd1c748d1fd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:41.710145 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6c7c48ef-7d05-433f-ac30-7bd1c748d1fd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:41.721607 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c7c48ef-7d05-433f-ac30-7bd1c748d1fd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.196311 Sep 19 17:37:41.722567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 572/1134] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:41 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:42.746382 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e2e8d3be-0a0e-4c2b-8852-ee047b13b26e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:42.747098 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e2e8d3be-0a0e-4c2b-8852-ee047b13b26e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:42.753459 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2e8d3be-0a0e-4c2b-8852-ee047b13b26e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:42.753953 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2e8d3be-0a0e-4c2b-8852-ee047b13b26e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:42.754399 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2e8d3be-0a0e-4c2b-8852-ee047b13b26e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:42.755106 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2e8d3be-0a0e-4c2b-8852-ee047b13b26e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:42.755567 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2e8d3be-0a0e-4c2b-8852-ee047b13b26e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:42.756070 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2e8d3be-0a0e-4c2b-8852-ee047b13b26e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:42.894957 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e2e8d3be-0a0e-4c2b-8852-ee047b13b26e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:42.903236 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e2e8d3be-0a0e-4c2b-8852-ee047b13b26e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.161558 Sep 19 17:37:42.903850 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 563/1135] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:42 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:43.925625 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87cea982-b367-48d3-ba48-a61c69edff65 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:43.926270 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87cea982-b367-48d3-ba48-a61c69edff65 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:43.933448 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87cea982-b367-48d3-ba48-a61c69edff65 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:43.933938 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87cea982-b367-48d3-ba48-a61c69edff65 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:43.934389 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87cea982-b367-48d3-ba48-a61c69edff65 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:43.935096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87cea982-b367-48d3-ba48-a61c69edff65 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:43.935556 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87cea982-b367-48d3-ba48-a61c69edff65 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:43.936022 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87cea982-b367-48d3-ba48-a61c69edff65 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:44.067449 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-87cea982-b367-48d3-ba48-a61c69edff65 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:44.076275 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87cea982-b367-48d3-ba48-a61c69edff65 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.154571 Sep 19 17:37:44.076924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 573/1136] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:43 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:45.100601 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-626dbab9-d2c9-4618-849d-24ea7ea0d141 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:45.101255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-626dbab9-d2c9-4618-849d-24ea7ea0d141 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:45.108112 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-626dbab9-d2c9-4618-849d-24ea7ea0d141 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:45.108688 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-626dbab9-d2c9-4618-849d-24ea7ea0d141 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:45.109136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-626dbab9-d2c9-4618-849d-24ea7ea0d141 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:45.109860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-626dbab9-d2c9-4618-849d-24ea7ea0d141 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:45.110373 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-626dbab9-d2c9-4618-849d-24ea7ea0d141 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:45.110874 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-626dbab9-d2c9-4618-849d-24ea7ea0d141 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:45.249247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-626dbab9-d2c9-4618-849d-24ea7ea0d141 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:45.258649 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-626dbab9-d2c9-4618-849d-24ea7ea0d141 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.162360 Sep 19 17:37:45.259221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 564/1137] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:45 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:46.281371 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae0323fe-eced-440e-adae-f6b685c98cd8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:46.281925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ae0323fe-eced-440e-adae-f6b685c98cd8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:46.297477 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae0323fe-eced-440e-adae-f6b685c98cd8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:46.297968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae0323fe-eced-440e-adae-f6b685c98cd8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:46.298443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae0323fe-eced-440e-adae-f6b685c98cd8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:46.299153 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae0323fe-eced-440e-adae-f6b685c98cd8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:46.299614 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae0323fe-eced-440e-adae-f6b685c98cd8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:46.300090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae0323fe-eced-440e-adae-f6b685c98cd8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:46.434007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ae0323fe-eced-440e-adae-f6b685c98cd8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:46.440284 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae0323fe-eced-440e-adae-f6b685c98cd8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.162943 Sep 19 17:37:46.440859 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 574/1138] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:46 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:47.464215 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f8de9e8-1787-4506-aa8d-a5435b8baed6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:47.464830 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6f8de9e8-1787-4506-aa8d-a5435b8baed6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:47.467303 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:47.472225 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8de9e8-1787-4506-aa8d-a5435b8baed6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:47.472714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8de9e8-1787-4506-aa8d-a5435b8baed6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:47.473159 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8de9e8-1787-4506-aa8d-a5435b8baed6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:47.473856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8de9e8-1787-4506-aa8d-a5435b8baed6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:47.474317 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8de9e8-1787-4506-aa8d-a5435b8baed6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:47.474792 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8de9e8-1787-4506-aa8d-a5435b8baed6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:47.607964 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-6f8de9e8-1787-4506-aa8d-a5435b8baed6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:47.615853 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f8de9e8-1787-4506-aa8d-a5435b8baed6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.155720 Sep 19 17:37:47.616342 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 565/1139] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:47 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:48.639482 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7b034fb7-5e4d-42e1-a3c6-356db55dfda6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:48.640056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7b034fb7-5e4d-42e1-a3c6-356db55dfda6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:48.641790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:48.642444 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:37:48.648165 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b034fb7-5e4d-42e1-a3c6-356db55dfda6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:48.648643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b034fb7-5e4d-42e1-a3c6-356db55dfda6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:48.649084 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b034fb7-5e4d-42e1-a3c6-356db55dfda6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:48.649769 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b034fb7-5e4d-42e1-a3c6-356db55dfda6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:48.650220 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b034fb7-5e4d-42e1-a3c6-356db55dfda6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:48.650666 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b034fb7-5e4d-42e1-a3c6-356db55dfda6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:48.784464 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7b034fb7-5e4d-42e1-a3c6-356db55dfda6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:48.792854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7b034fb7-5e4d-42e1-a3c6-356db55dfda6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.157358 Sep 19 17:37:48.793419 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 575/1140] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:48 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:49.815140 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1ebee60-ff85-4c3e-993b-256d190d9f00 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:49.815717 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1ebee60-ff85-4c3e-993b-256d190d9f00 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:49.821905 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ebee60-ff85-4c3e-993b-256d190d9f00 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:49.822386 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ebee60-ff85-4c3e-993b-256d190d9f00 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:49.822825 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ebee60-ff85-4c3e-993b-256d190d9f00 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:49.823516 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ebee60-ff85-4c3e-993b-256d190d9f00 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:49.824012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ebee60-ff85-4c3e-993b-256d190d9f00 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:49.824438 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ebee60-ff85-4c3e-993b-256d190d9f00 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:49.964971 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1ebee60-ff85-4c3e-993b-256d190d9f00 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:49.972645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1ebee60-ff85-4c3e-993b-256d190d9f00 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.161612 Sep 19 17:37:49.973216 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 566/1141] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:49 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:50.995945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-94746754-86cd-431d-966e-89f0f926ea48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:50.996502 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-94746754-86cd-431d-966e-89f0f926ea48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:51.002917 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94746754-86cd-431d-966e-89f0f926ea48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:51.003408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94746754-86cd-431d-966e-89f0f926ea48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:51.004059 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94746754-86cd-431d-966e-89f0f926ea48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:51.004769 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94746754-86cd-431d-966e-89f0f926ea48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:51.005231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94746754-86cd-431d-966e-89f0f926ea48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:51.005662 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94746754-86cd-431d-966e-89f0f926ea48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:51.139068 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-94746754-86cd-431d-966e-89f0f926ea48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:51.147018 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-94746754-86cd-431d-966e-89f0f926ea48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.155054 Sep 19 17:37:51.148287 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 576/1142] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:50 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:52.170555 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1a907978-35e2-459b-8774-520a960796ab tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:52.171166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1a907978-35e2-459b-8774-520a960796ab tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:52.177678 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a907978-35e2-459b-8774-520a960796ab tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:52.178159 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a907978-35e2-459b-8774-520a960796ab tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:52.178596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a907978-35e2-459b-8774-520a960796ab tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:52.179849 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a907978-35e2-459b-8774-520a960796ab tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:52.180378 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a907978-35e2-459b-8774-520a960796ab tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:52.180833 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a907978-35e2-459b-8774-520a960796ab tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:52.314094 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a907978-35e2-459b-8774-520a960796ab tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:52.322556 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1a907978-35e2-459b-8774-520a960796ab tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.155884 Sep 19 17:37:52.323159 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 567/1143] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:52 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:53.345461 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df2ef7bd-4a1c-45a6-8931-a86e2d00d7d9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:53.346069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df2ef7bd-4a1c-45a6-8931-a86e2d00d7d9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:53.353048 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2ef7bd-4a1c-45a6-8931-a86e2d00d7d9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:53.353531 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2ef7bd-4a1c-45a6-8931-a86e2d00d7d9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:53.353965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2ef7bd-4a1c-45a6-8931-a86e2d00d7d9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:53.354654 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2ef7bd-4a1c-45a6-8931-a86e2d00d7d9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:53.355106 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2ef7bd-4a1c-45a6-8931-a86e2d00d7d9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:53.355525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2ef7bd-4a1c-45a6-8931-a86e2d00d7d9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:53.484564 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-df2ef7bd-4a1c-45a6-8931-a86e2d00d7d9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:53.492255 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df2ef7bd-4a1c-45a6-8931-a86e2d00d7d9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.150667 Sep 19 17:37:53.492829 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 577/1144] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:53 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:54.514944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24ca5691-76e9-4849-87cd-09cdfb91c567 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:54.515561 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-24ca5691-76e9-4849-87cd-09cdfb91c567 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:54.522082 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24ca5691-76e9-4849-87cd-09cdfb91c567 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:54.522566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24ca5691-76e9-4849-87cd-09cdfb91c567 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:54.523006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24ca5691-76e9-4849-87cd-09cdfb91c567 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:54.524288 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24ca5691-76e9-4849-87cd-09cdfb91c567 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:54.524748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24ca5691-76e9-4849-87cd-09cdfb91c567 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:54.525169 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24ca5691-76e9-4849-87cd-09cdfb91c567 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:54.663469 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-24ca5691-76e9-4849-87cd-09cdfb91c567 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:54.671878 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-24ca5691-76e9-4849-87cd-09cdfb91c567 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.160918 Sep 19 17:37:54.672461 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 568/1145] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:54 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:55.694328 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3daa469b-f6fc-4d01-82a3-b9286d0f3b5d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:55.707636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3daa469b-f6fc-4d01-82a3-b9286d0f3b5d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:55.707636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3daa469b-f6fc-4d01-82a3-b9286d0f3b5d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:55.707636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3daa469b-f6fc-4d01-82a3-b9286d0f3b5d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:55.707636 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3daa469b-f6fc-4d01-82a3-b9286d0f3b5d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:55.708093 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3daa469b-f6fc-4d01-82a3-b9286d0f3b5d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:55.708093 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3daa469b-f6fc-4d01-82a3-b9286d0f3b5d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:55.708093 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3daa469b-f6fc-4d01-82a3-b9286d0f3b5d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:55.837567 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-3daa469b-f6fc-4d01-82a3-b9286d0f3b5d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:55.845223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3daa469b-f6fc-4d01-82a3-b9286d0f3b5d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.154756 Sep 19 17:37:55.845780 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 578/1146] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:55 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:56.868970 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-32c0998a-23c6-4369-85fc-1e3bcd85100e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:56.869635 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-32c0998a-23c6-4369-85fc-1e3bcd85100e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:56.876118 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c0998a-23c6-4369-85fc-1e3bcd85100e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:56.876606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c0998a-23c6-4369-85fc-1e3bcd85100e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:56.877053 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c0998a-23c6-4369-85fc-1e3bcd85100e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:56.877750 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c0998a-23c6-4369-85fc-1e3bcd85100e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:56.878276 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c0998a-23c6-4369-85fc-1e3bcd85100e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:56.878672 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c0998a-23c6-4369-85fc-1e3bcd85100e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:57.012889 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-32c0998a-23c6-4369-85fc-1e3bcd85100e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:57.020913 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-32c0998a-23c6-4369-85fc-1e3bcd85100e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.156310 Sep 19 17:37:57.021720 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 569/1147] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:56 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:57.213221 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e9288b46-435c-4c40-9543-d0c785860857 req-182fe610-0e94-40da-94f9-1a08568a9f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf0413e-fde3-4cb9-bed3-1dd053a94609", "name": "network-vif-plugged", "status": "completed", "tag": "ceaaa721-b6be-4326-b3ea-f412d7f7f544"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:37:57.223205 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e9288b46-435c-4c40-9543-d0c785860857 req-182fe610-0e94-40da-94f9-1a08568a9f9d service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:57.223672 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e9288b46-435c-4c40-9543-d0c785860857 req-182fe610-0e94-40da-94f9-1a08568a9f9d service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:57.224121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e9288b46-435c-4c40-9543-d0c785860857 req-182fe610-0e94-40da-94f9-1a08568a9f9d service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:57.235511 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e9288b46-435c-4c40-9543-d0c785860857 req-182fe610-0e94-40da-94f9-1a08568a9f9d service nova] Creating event network-vif-plugged:ceaaa721-b6be-4326-b3ea-f412d7f7f544 for instance faf0413e-fde3-4cb9-bed3-1dd053a94609 on hv-cinder-84801 Sep 19 17:37:57.240568 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e9288b46-435c-4c40-9543-d0c785860857 req-182fe610-0e94-40da-94f9-1a08568a9f9d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031145 Sep 19 17:37:57.241191 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 579/1148] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:37:58.048628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2b1bec56-e5e3-4f4f-abe4-31194071813c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:58.049247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2b1bec56-e5e3-4f4f-abe4-31194071813c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:58.056559 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b1bec56-e5e3-4f4f-abe4-31194071813c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:58.057052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b1bec56-e5e3-4f4f-abe4-31194071813c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:58.057495 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b1bec56-e5e3-4f4f-abe4-31194071813c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:58.058197 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b1bec56-e5e3-4f4f-abe4-31194071813c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:58.058654 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b1bec56-e5e3-4f4f-abe4-31194071813c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:58.059083 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b1bec56-e5e3-4f4f-abe4-31194071813c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:58.191530 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2b1bec56-e5e3-4f4f-abe4-31194071813c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:58.201316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2b1bec56-e5e3-4f4f-abe4-31194071813c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.156544 Sep 19 17:37:58.201904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 570/1149] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:58 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:37:59.225457 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c6d543f-b1b1-4388-8574-f717c3e3cd01 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:37:59.226159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c6d543f-b1b1-4388-8574-f717c3e3cd01 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:37:59.232480 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c6d543f-b1b1-4388-8574-f717c3e3cd01 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:59.232969 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c6d543f-b1b1-4388-8574-f717c3e3cd01 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:59.233406 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c6d543f-b1b1-4388-8574-f717c3e3cd01 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:59.234102 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c6d543f-b1b1-4388-8574-f717c3e3cd01 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:37:59.234559 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c6d543f-b1b1-4388-8574-f717c3e3cd01 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:37:59.234988 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c6d543f-b1b1-4388-8574-f717c3e3cd01 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:37:59.368504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c6d543f-b1b1-4388-8574-f717c3e3cd01 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:37:59.376307 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c6d543f-b1b1-4388-8574-f717c3e3cd01 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.155593 Sep 19 17:37:59.376873 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 580/1150] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:37:59 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:38:00.399594 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2dafa376-10fc-49c8-9e98-9869399cc42f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:38:00.400255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2dafa376-10fc-49c8-9e98-9869399cc42f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:38:00.406861 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dafa376-10fc-49c8-9e98-9869399cc42f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:38:00.407348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dafa376-10fc-49c8-9e98-9869399cc42f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:38:00.407818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dafa376-10fc-49c8-9e98-9869399cc42f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:38:00.408515 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dafa376-10fc-49c8-9e98-9869399cc42f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:38:00.408968 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dafa376-10fc-49c8-9e98-9869399cc42f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:38:00.409400 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dafa376-10fc-49c8-9e98-9869399cc42f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:38:00.540035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2dafa376-10fc-49c8-9e98-9869399cc42f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:38:00.547843 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2dafa376-10fc-49c8-9e98-9869399cc42f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.152156 Sep 19 17:38:00.548416 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 571/1151] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:38:00 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:38:01.571423 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8a5ee2b9-45ce-49d8-9bf7-459202021fd5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:38:01.572130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8a5ee2b9-45ce-49d8-9bf7-459202021fd5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:38:01.578651 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a5ee2b9-45ce-49d8-9bf7-459202021fd5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:38:01.579163 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a5ee2b9-45ce-49d8-9bf7-459202021fd5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:38:01.579642 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a5ee2b9-45ce-49d8-9bf7-459202021fd5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:38:01.580409 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a5ee2b9-45ce-49d8-9bf7-459202021fd5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:38:01.580859 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a5ee2b9-45ce-49d8-9bf7-459202021fd5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:38:01.581286 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a5ee2b9-45ce-49d8-9bf7-459202021fd5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:38:01.714914 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8a5ee2b9-45ce-49d8-9bf7-459202021fd5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:38:01.722885 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8a5ee2b9-45ce-49d8-9bf7-459202021fd5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.156076 Sep 19 17:38:01.723478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 581/1152] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:38:01 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:38:02.746482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-445f9ec7-e441-441f-94f5-725a232d492a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:38:02.747887 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-445f9ec7-e441-441f-94f5-725a232d492a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:38:02.754762 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-445f9ec7-e441-441f-94f5-725a232d492a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:38:02.755475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-445f9ec7-e441-441f-94f5-725a232d492a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:38:02.756035 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-445f9ec7-e441-441f-94f5-725a232d492a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:38:02.756792 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-445f9ec7-e441-441f-94f5-725a232d492a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:38:02.757291 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-445f9ec7-e441-441f-94f5-725a232d492a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:38:02.757969 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-445f9ec7-e441-441f-94f5-725a232d492a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:38:02.902037 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-445f9ec7-e441-441f-94f5-725a232d492a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:38:02.907292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-445f9ec7-e441-441f-94f5-725a232d492a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1266 microversion: 2.1 time: 0.165148 Sep 19 17:38:02.907896 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 572/1153] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:38:02 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:38:03.931985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d85c9d5-1872-457d-811a-91ed5f7e89b7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:38:03.932600 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d85c9d5-1872-457d-811a-91ed5f7e89b7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:38:03.939052 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d85c9d5-1872-457d-811a-91ed5f7e89b7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:38:03.939548 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d85c9d5-1872-457d-811a-91ed5f7e89b7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:38:03.940021 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d85c9d5-1872-457d-811a-91ed5f7e89b7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:38:03.940727 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d85c9d5-1872-457d-811a-91ed5f7e89b7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:38:03.941183 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d85c9d5-1872-457d-811a-91ed5f7e89b7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:38:03.941616 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d85c9d5-1872-457d-811a-91ed5f7e89b7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:38:04.069627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d85c9d5-1872-457d-811a-91ed5f7e89b7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:38:04.077399 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d85c9d5-1872-457d-811a-91ed5f7e89b7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1453 microversion: 2.1 time: 0.150021 Sep 19 17:38:04.077965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 582/1154] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:38:03 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:38:04.100029 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ac5c302-0b14-4e0c-8611-dfe5c18a86dd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:38:04.100649 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ac5c302-0b14-4e0c-8611-dfe5c18a86dd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:38:04.107737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac5c302-0b14-4e0c-8611-dfe5c18a86dd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:38:04.108235 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac5c302-0b14-4e0c-8611-dfe5c18a86dd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:38:04.108676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac5c302-0b14-4e0c-8611-dfe5c18a86dd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:38:04.109375 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac5c302-0b14-4e0c-8611-dfe5c18a86dd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:38:04.109838 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac5c302-0b14-4e0c-8611-dfe5c18a86dd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:38:04.110304 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac5c302-0b14-4e0c-8611-dfe5c18a86dd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:38:04.268190 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8ac5c302-0b14-4e0c-8611-dfe5c18a86dd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:38:04.280961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ac5c302-0b14-4e0c-8611-dfe5c18a86dd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1453 microversion: 2.1 time: 0.180356 Sep 19 17:38:04.280961 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 573/1155] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:38:04 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:38:06.746443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-36a7d6f7-1104-4279-b4a3-5a7d1367d37d req-777d4207-ec0d-432a-843d-1b2049e1dbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf0413e-fde3-4cb9-bed3-1dd053a94609", "tag": "ceaaa721-b6be-4326-b3ea-f412d7f7f544"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:38:06.751389 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:38:06.756665 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-36a7d6f7-1104-4279-b4a3-5a7d1367d37d req-777d4207-ec0d-432a-843d-1b2049e1dbe2 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:38:06.759529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-36a7d6f7-1104-4279-b4a3-5a7d1367d37d req-777d4207-ec0d-432a-843d-1b2049e1dbe2 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:38:06.759529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-36a7d6f7-1104-4279-b4a3-5a7d1367d37d req-777d4207-ec0d-432a-843d-1b2049e1dbe2 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:38:06.761002 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=77 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:38:06.770209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-36a7d6f7-1104-4279-b4a3-5a7d1367d37d req-777d4207-ec0d-432a-843d-1b2049e1dbe2 service nova] Creating event network-changed:ceaaa721-b6be-4326-b3ea-f412d7f7f544 for instance faf0413e-fde3-4cb9-bed3-1dd053a94609 on hv-cinder-84801 Sep 19 17:38:06.775957 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-36a7d6f7-1104-4279-b4a3-5a7d1367d37d req-777d4207-ec0d-432a-843d-1b2049e1dbe2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153424 Sep 19 17:38:06.776570 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 583/1156] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:39:09.154392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=30 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:39:09.155246 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=74 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:39:09.156700 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 17:39:09.156858 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Mon Sep 19 17:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/ips (ip 10.222.0.61) !!! Sep 19 17:39:09.162072 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5fb2379a-2bbe-45ae-a2be-f95b0ffc0495 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:09.168157 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5fb2379a-2bbe-45ae-a2be-f95b0ffc0495 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:09.169224 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fb2379a-2bbe-45ae-a2be-f95b0ffc0495 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:09.169707 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fb2379a-2bbe-45ae-a2be-f95b0ffc0495 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:09.170144 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fb2379a-2bbe-45ae-a2be-f95b0ffc0495 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:09.170847 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fb2379a-2bbe-45ae-a2be-f95b0ffc0495 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:09.171295 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fb2379a-2bbe-45ae-a2be-f95b0ffc0495 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:09.171751 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fb2379a-2bbe-45ae-a2be-f95b0ffc0495 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:09.196491 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5fb2379a-2bbe-45ae-a2be-f95b0ffc0495 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/ips" status: 200 len: 149 microversion: 2.1 time: 0.043746 Sep 19 17:39:09.197044 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 574/1157] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Sep 19 17:39:09 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:39:11.840420 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 17:39:11.840948 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Mon Sep 19 17:39:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments (ip 10.222.0.61) !!! Sep 19 17:39:11.846761 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fa94d71e-59be-48f1-b92a-62e6cbe167d2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5126f39f-479b-45bd-a808-b25075d7d910"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:39:11.849186 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fa94d71e-59be-48f1-b92a-62e6cbe167d2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:11.857550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa94d71e-59be-48f1-b92a-62e6cbe167d2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:11.858075 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa94d71e-59be-48f1-b92a-62e6cbe167d2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:11.858515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa94d71e-59be-48f1-b92a-62e6cbe167d2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:11.859219 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa94d71e-59be-48f1-b92a-62e6cbe167d2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:11.859676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa94d71e-59be-48f1-b92a-62e6cbe167d2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:11.860127 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa94d71e-59be-48f1-b92a-62e6cbe167d2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:12.725695 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fa94d71e-59be-48f1-b92a-62e6cbe167d2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888076 Sep 19 17:39:12.726281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 584/1158] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:39:11 2022] POST /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:39:21.328574 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5126f39f-479b-45bd-a808-b25075d7d910"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:39:21.330923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:21.334250 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:39:21.338691 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:21.339183 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:21.339627 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:21.340362 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:21.340831 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:21.341273 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:21.483950 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Invalid volume: volume 5126f39f-479b-45bd-a808-b25075d7d910 is already attached to instances: c5770044-beb3-4748-b53c-c2487feab9f8 Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments HTTP/1.1 Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 74 Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:39:21.485661 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {"volumeAttachment": {"volumeId": "5126f39f-479b-45bd-a808-b25075d7d910"}} Sep 19 17:39:21.487646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Invalid volume: volume 5126f39f-479b-45bd-a808-b25075d7d910 is already attached to instances: c5770044-beb3-4748-b53c-c2487feab9f8 Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'server_id': 'c5770044-beb3-4748-b53c-c2487feab9f8', 'body': {'volumeAttachment': {'volumeId': '5126f39f-479b-45bd-a808-b25075d7d910'}}} Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5126f39f-479b-45bd-a808-b25075d7d910 is already attached to instances: c5770044-beb3-4748-b53c-c2487feab9f8 Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:39:21.488719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5126f39f-479b-45bd-a808-b25075d7d910 is already attached to instances: c5770044-beb3-4748-b53c-c2487feab9f8 Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:39:21.490104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:39:21.491533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:39:21.491533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:39:21.491533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:39:21.491533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5126f39f-479b-45bd-a808-b25075d7d910 is already attached to instances: c5770044-beb3-4748-b53c-c2487feab9f8 Sep 19 17:39:21.491533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:39:21.491533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 400 to user: Invalid volume: volume 5126f39f-479b-45bd-a808-b25075d7d910 is already attached to instances: c5770044-beb3-4748-b53c-c2487feab9f8 {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:39:21.491533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-296b5a83-1125-4541-8c1a-f072464de0ab tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.162717 Sep 19 17:39:21.491533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 575/1159] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:39:21 2022] POST /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments => generated 174 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 17:39:21.561533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-634c0733-f965-48af-a51b-69a424603929 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:21.562141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-634c0733-f965-48af-a51b-69a424603929 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:21.568573 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-634c0733-f965-48af-a51b-69a424603929 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:21.569058 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-634c0733-f965-48af-a51b-69a424603929 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:21.569515 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-634c0733-f965-48af-a51b-69a424603929 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:21.570217 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-634c0733-f965-48af-a51b-69a424603929 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:21.570670 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-634c0733-f965-48af-a51b-69a424603929 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:21.571093 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-634c0733-f965-48af-a51b-69a424603929 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:21.654168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-634c0733-f965-48af-a51b-69a424603929 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lazy-loading 'services' on Instance uuid c5770044-beb3-4748-b53c-c2487feab9f8 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:39:21.876952 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-634c0733-f965-48af-a51b-69a424603929 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments/5126f39f-479b-45bd-a808-b25075d7d910" status: 202 len: 0 microversion: 2.1 time: 0.319972 Sep 19 17:39:21.877572 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 585/1160] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:39:21 2022] DELETE /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments/5126f39f-479b-45bd-a808-b25075d7d910 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:39:21.887398 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-01920ddb-0b46-4a53-bde1-07f247e5067b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:21.889730 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-01920ddb-0b46-4a53-bde1-07f247e5067b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:21.897608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01920ddb-0b46-4a53-bde1-07f247e5067b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:21.898923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01920ddb-0b46-4a53-bde1-07f247e5067b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:21.898923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01920ddb-0b46-4a53-bde1-07f247e5067b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:21.899257 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01920ddb-0b46-4a53-bde1-07f247e5067b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:21.899784 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01920ddb-0b46-4a53-bde1-07f247e5067b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:21.900149 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01920ddb-0b46-4a53-bde1-07f247e5067b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:21.931385 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-01920ddb-0b46-4a53-bde1-07f247e5067b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048267 Sep 19 17:39:21.931989 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 576/1161] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:39:21 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:39:22.947287 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-37e2d8d3-fcd9-4428-9a41-67ac8563939b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:22.951637 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-37e2d8d3-fcd9-4428-9a41-67ac8563939b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:22.955814 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37e2d8d3-fcd9-4428-9a41-67ac8563939b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:22.956296 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37e2d8d3-fcd9-4428-9a41-67ac8563939b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:22.956732 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37e2d8d3-fcd9-4428-9a41-67ac8563939b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:22.957427 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37e2d8d3-fcd9-4428-9a41-67ac8563939b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:22.957882 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37e2d8d3-fcd9-4428-9a41-67ac8563939b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:22.958340 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37e2d8d3-fcd9-4428-9a41-67ac8563939b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:22.988326 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-37e2d8d3-fcd9-4428-9a41-67ac8563939b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046391 Sep 19 17:39:22.988895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 586/1162] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:39:22 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:39:24.001348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ff4d3a0-908a-4c8d-b2f7-57c927bd82c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:24.003755 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ff4d3a0-908a-4c8d-b2f7-57c927bd82c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:24.011329 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3a0-908a-4c8d-b2f7-57c927bd82c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:24.011882 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3a0-908a-4c8d-b2f7-57c927bd82c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:24.012370 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3a0-908a-4c8d-b2f7-57c927bd82c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:24.013068 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3a0-908a-4c8d-b2f7-57c927bd82c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:24.013522 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3a0-908a-4c8d-b2f7-57c927bd82c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:24.013948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3a0-908a-4c8d-b2f7-57c927bd82c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:24.042382 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ff4d3a0-908a-4c8d-b2f7-57c927bd82c0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045262 Sep 19 17:39:24.042934 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 577/1163] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:39:23 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 17:39:24.105889 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5916a711-74d0-4b7e-9364-05d5c296a1b3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:24.106437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5916a711-74d0-4b7e-9364-05d5c296a1b3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:24.112892 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5916a711-74d0-4b7e-9364-05d5c296a1b3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:24.113374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5916a711-74d0-4b7e-9364-05d5c296a1b3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:24.113815 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5916a711-74d0-4b7e-9364-05d5c296a1b3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:24.114511 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5916a711-74d0-4b7e-9364-05d5c296a1b3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:24.114965 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5916a711-74d0-4b7e-9364-05d5c296a1b3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:24.115390 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5916a711-74d0-4b7e-9364-05d5c296a1b3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:24.141234 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5916a711-74d0-4b7e-9364-05d5c296a1b3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:39:24.387996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5916a711-74d0-4b7e-9364-05d5c296a1b3 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 204 len: 0 microversion: 2.1 time: 0.285601 Sep 19 17:39:24.388579 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 587/1164] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:39:24 2022] DELETE /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 17:39:24.396804 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-573d27aa-d2e9-4651-8ffa-3b9de5a8605f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:24.397429 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-573d27aa-d2e9-4651-8ffa-3b9de5a8605f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:24.403426 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-573d27aa-d2e9-4651-8ffa-3b9de5a8605f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:24.403941 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-573d27aa-d2e9-4651-8ffa-3b9de5a8605f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:24.404384 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-573d27aa-d2e9-4651-8ffa-3b9de5a8605f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:24.405076 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-573d27aa-d2e9-4651-8ffa-3b9de5a8605f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:24.405531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-573d27aa-d2e9-4651-8ffa-3b9de5a8605f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:24.405962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-573d27aa-d2e9-4651-8ffa-3b9de5a8605f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:24.541608 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-573d27aa-d2e9-4651-8ffa-3b9de5a8605f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:24.549230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-573d27aa-d2e9-4651-8ffa-3b9de5a8605f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1682 microversion: 2.1 time: 0.156318 Sep 19 17:39:24.549794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 578/1165] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:24 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:25.574024 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9cd248a5-d3fa-4776-ab2c-b95eb9a2a789 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:25.574736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9cd248a5-d3fa-4776-ab2c-b95eb9a2a789 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:25.581096 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cd248a5-d3fa-4776-ab2c-b95eb9a2a789 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:25.581599 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cd248a5-d3fa-4776-ab2c-b95eb9a2a789 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:25.582035 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cd248a5-d3fa-4776-ab2c-b95eb9a2a789 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:25.582733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cd248a5-d3fa-4776-ab2c-b95eb9a2a789 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:25.583195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cd248a5-d3fa-4776-ab2c-b95eb9a2a789 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:25.583626 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cd248a5-d3fa-4776-ab2c-b95eb9a2a789 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:25.714938 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9cd248a5-d3fa-4776-ab2c-b95eb9a2a789 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:25.722643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9cd248a5-d3fa-4776-ab2c-b95eb9a2a789 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1682 microversion: 2.1 time: 0.152874 Sep 19 17:39:25.723213 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 588/1166] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:25 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:26.747148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92c53f9f-ea79-486f-8eb5-c49e080a2354 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:26.747685 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-92c53f9f-ea79-486f-8eb5-c49e080a2354 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:26.754138 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92c53f9f-ea79-486f-8eb5-c49e080a2354 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:26.754630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92c53f9f-ea79-486f-8eb5-c49e080a2354 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:26.755064 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92c53f9f-ea79-486f-8eb5-c49e080a2354 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:26.756047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92c53f9f-ea79-486f-8eb5-c49e080a2354 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:26.756619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92c53f9f-ea79-486f-8eb5-c49e080a2354 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:26.757234 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92c53f9f-ea79-486f-8eb5-c49e080a2354 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:26.886456 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-92c53f9f-ea79-486f-8eb5-c49e080a2354 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:26.895031 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-92c53f9f-ea79-486f-8eb5-c49e080a2354 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1682 microversion: 2.1 time: 0.151881 Sep 19 17:39:26.895606 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 579/1167] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:26 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:27.888155 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-11252dab-2b71-4a35-8b0f-3fbd82663102 req-9f463806-1daa-4528-a613-63d2fd20fa59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5770044-beb3-4748-b53c-c2487feab9f8", "name": "network-vif-deleted", "tag": "065f60d9-1405-4ef7-a649-7c8d93430d74"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:39:27.899749 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-11252dab-2b71-4a35-8b0f-3fbd82663102 req-9f463806-1daa-4528-a613-63d2fd20fa59 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:27.900316 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-11252dab-2b71-4a35-8b0f-3fbd82663102 req-9f463806-1daa-4528-a613-63d2fd20fa59 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:27.901016 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-11252dab-2b71-4a35-8b0f-3fbd82663102 req-9f463806-1daa-4528-a613-63d2fd20fa59 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:27.920889 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9e74a92f-f89e-4645-a8cd-4cd1c1f9e5c7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:27.922281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9e74a92f-f89e-4645-a8cd-4cd1c1f9e5c7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:27.927982 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-11252dab-2b71-4a35-8b0f-3fbd82663102 req-9f463806-1daa-4528-a613-63d2fd20fa59 service nova] Creating event network-vif-deleted:065f60d9-1405-4ef7-a649-7c8d93430d74 for instance c5770044-beb3-4748-b53c-c2487feab9f8 on hv-cinder-84801 Sep 19 17:39:27.930668 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e74a92f-f89e-4645-a8cd-4cd1c1f9e5c7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:27.931245 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e74a92f-f89e-4645-a8cd-4cd1c1f9e5c7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:27.931916 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e74a92f-f89e-4645-a8cd-4cd1c1f9e5c7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:27.933359 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e74a92f-f89e-4645-a8cd-4cd1c1f9e5c7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:27.933359 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e74a92f-f89e-4645-a8cd-4cd1c1f9e5c7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:27.934311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-11252dab-2b71-4a35-8b0f-3fbd82663102 req-9f463806-1daa-4528-a613-63d2fd20fa59 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049803 Sep 19 17:39:27.935575 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 589/1168] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:39:27.940231 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e74a92f-f89e-4645-a8cd-4cd1c1f9e5c7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:28.014912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-9e74a92f-f89e-4645-a8cd-4cd1c1f9e5c7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:28.023517 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9e74a92f-f89e-4645-a8cd-4cd1c1f9e5c7 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1614 microversion: 2.1 time: 0.107337 Sep 19 17:39:28.024330 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 580/1169] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:27 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1614 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:39:29.054873 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:29.055727 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:29.062138 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:29.062634 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:29.063080 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:29.063822 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:29.064295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:29.064729 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:29.103948 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:29.103948 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:29.103948 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:29.104511 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lazy-loading 'fault' on Instance uuid c5770044-beb3-4748-b53c-c2487feab9f8 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:39:29.145996 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:29.154587 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-502938c0-2cd4-4461-ab4f-1e32e2f5de2f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 200 len: 1332 microversion: 2.1 time: 0.105017 Sep 19 17:39:29.157929 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 590/1170] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:29 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:30.178148 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:30.178752 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:30.185129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:30.185607 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:30.186047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:30.186740 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:30.187195 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:30.187618 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:30.200686 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 HTTP/1.1 Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:39:30.202200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:39:30.204003 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': 'c5770044-beb3-4748-b53c-c2487feab9f8'} Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:39:30.205179 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:39:30.206912 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:39:30.208588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:39:30.208588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-519de0c3-2aaf-423c-abfa-b71ecb021b82 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 404 len: 111 microversion: 2.1 time: 0.029428 Sep 19 17:39:30.208588 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 581/1171] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:30 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:39:30.213313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f86dd1c1-f8ef-4bc4-af5a-550dc352c8d2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '.version_select at 0x7fd4d60a8310>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:30.292948 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f86dd1c1-f8ef-4bc4-af5a-550dc352c8d2 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209670566" status: 202 len: 0 microversion: 2.1 time: 0.084280 Sep 19 17:39:30.293583 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 591/1172] 10.222.0.61 () {58 vars in 1221 bytes} [Mon Sep 19 17:39:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209670566 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:39:31.025843 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6dcd9066-42f1-4312-9557-757cb96085bd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: .version_select at 0x7fd4d6062430>, body: {"keypair": {"name": "tempest-keypair-1516910933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAt7b8s5XdQmsaM0FUJi7cyaBDQx8o3VwECT+vVd2NLT6vG7OKnXqPn2VmfSMnOkBQbyOI5dD/OlSQjzubelk5Yohd/I7uZKTvXd3yzg5ff7/cT+iAsT4ZH8c1lfFHuBQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:39:31.041356 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-6dcd9066-42f1-4312-9557-757cb96085bd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:39:31.045083 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-6dcd9066-42f1-4312-9557-757cb96085bd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for user a8e4233c03174fa18deb6baad431543b and project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:39:31.169931 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6dcd9066-42f1-4312-9557-757cb96085bd tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147788 Sep 19 17:39:31.170472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 582/1173] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Sep 19 17:39:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:39:33.369268 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1353505829", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee3141f2-3b76-40de-a3df-4fd096ef3d26"}], "security_groups": [{"name": "tempest-securitygroup--1208825071"}], "key_name": "tempest-keypair-1516910933", "user_data": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:39:33.470844 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] validate_networks() for [('ee3141f2-3b76-40de-a3df-4fd096ef3d26', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:39:33.944126 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:39:33.944670 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:39:33.945562 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:39:33.945562 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:39:33.947830 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:39:33.957820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:33.958295 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:33.958728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:33.959447 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:33.960017 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:33.960962 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:33.982002 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:39:33.985962 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Getting quotas for user a8e4233c03174fa18deb6baad431543b and project 8f2c3b46d08c4bf5a149abc8fe589909. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:39:33.998249 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:39:34.000740 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:39:34.136766 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3dee7d55-b027-4704-9b15-4ce87c61c133 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.773060 Sep 19 17:39:34.137478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 592/1174] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:39:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:39:34.149470 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-44d60257-5eb5-4bd6-ac44-dec79b7792fb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:34.150098 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-44d60257-5eb5-4bd6-ac44-dec79b7792fb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:34.214379 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-44d60257-5eb5-4bd6-ac44-dec79b7792fb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:34.221892 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-44d60257-5eb5-4bd6-ac44-dec79b7792fb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1242 microversion: 2.1 time: 0.076852 Sep 19 17:39:34.222798 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 583/1175] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:34 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:35.248081 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e996cfc7-0395-409a-b9a3-c5cd93ff63ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:35.248685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e996cfc7-0395-409a-b9a3-c5cd93ff63ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:35.254859 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e996cfc7-0395-409a-b9a3-c5cd93ff63ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:35.255588 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e996cfc7-0395-409a-b9a3-c5cd93ff63ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:35.256083 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e996cfc7-0395-409a-b9a3-c5cd93ff63ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:35.256776 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e996cfc7-0395-409a-b9a3-c5cd93ff63ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:35.257310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e996cfc7-0395-409a-b9a3-c5cd93ff63ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:35.258521 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e996cfc7-0395-409a-b9a3-c5cd93ff63ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:35.321807 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e996cfc7-0395-409a-b9a3-c5cd93ff63ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:35.329461 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e996cfc7-0395-409a-b9a3-c5cd93ff63ee tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1246 microversion: 2.1 time: 0.085838 Sep 19 17:39:35.330048 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 593/1176] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:35 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:36.352463 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5002260-3eeb-4a5f-af3b-92b248f6313e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:36.353090 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a5002260-3eeb-4a5f-af3b-92b248f6313e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:36.359853 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5002260-3eeb-4a5f-af3b-92b248f6313e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:36.360347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5002260-3eeb-4a5f-af3b-92b248f6313e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:36.360794 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5002260-3eeb-4a5f-af3b-92b248f6313e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:36.361675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5002260-3eeb-4a5f-af3b-92b248f6313e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:36.362012 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5002260-3eeb-4a5f-af3b-92b248f6313e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:36.363126 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5002260-3eeb-4a5f-af3b-92b248f6313e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:36.431193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a5002260-3eeb-4a5f-af3b-92b248f6313e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:36.440519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5002260-3eeb-4a5f-af3b-92b248f6313e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1302 microversion: 2.1 time: 0.091865 Sep 19 17:39:36.441104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 584/1177] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:36 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1302 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:39:37.464148 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ef53fec-d1dc-4b5b-a6e2-17d947c27dc4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:37.464870 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1ef53fec-d1dc-4b5b-a6e2-17d947c27dc4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:37.471370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef53fec-d1dc-4b5b-a6e2-17d947c27dc4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:37.472048 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef53fec-d1dc-4b5b-a6e2-17d947c27dc4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:37.473392 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef53fec-d1dc-4b5b-a6e2-17d947c27dc4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:37.473392 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef53fec-d1dc-4b5b-a6e2-17d947c27dc4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:37.474592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef53fec-d1dc-4b5b-a6e2-17d947c27dc4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:37.474592 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef53fec-d1dc-4b5b-a6e2-17d947c27dc4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:37.614901 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1ef53fec-d1dc-4b5b-a6e2-17d947c27dc4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:37.619269 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1ef53fec-d1dc-4b5b-a6e2-17d947c27dc4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1368 microversion: 2.1 time: 0.159054 Sep 19 17:39:37.619903 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 594/1178] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:37 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:38.213997 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7971fcf0-de59-4e76-ac86-43e6bf501771 req-0d7c8201-c4c3-4ec9-8cf0-e86dd1d583e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f52bff58-e6e4-4669-8acf-02750b2072d2", "tag": "f770338d-09a8-4720-8326-afeefa1e6b3e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:39:38.228962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7971fcf0-de59-4e76-ac86-43e6bf501771 req-0d7c8201-c4c3-4ec9-8cf0-e86dd1d583e3 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:38.236291 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7971fcf0-de59-4e76-ac86-43e6bf501771 req-0d7c8201-c4c3-4ec9-8cf0-e86dd1d583e3 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:38.236291 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7971fcf0-de59-4e76-ac86-43e6bf501771 req-0d7c8201-c4c3-4ec9-8cf0-e86dd1d583e3 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:38.241535 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7971fcf0-de59-4e76-ac86-43e6bf501771 req-0d7c8201-c4c3-4ec9-8cf0-e86dd1d583e3 service nova] Creating event network-changed:f770338d-09a8-4720-8326-afeefa1e6b3e for instance f52bff58-e6e4-4669-8acf-02750b2072d2 on hv-cinder-84801 Sep 19 17:39:38.247169 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7971fcf0-de59-4e76-ac86-43e6bf501771 req-0d7c8201-c4c3-4ec9-8cf0-e86dd1d583e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042884 Sep 19 17:39:38.247947 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 585/1179] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:39:38.644060 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-871bf106-0743-4e09-b6bd-862ae9b2d476 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:38.644765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-871bf106-0743-4e09-b6bd-862ae9b2d476 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:38.652376 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-871bf106-0743-4e09-b6bd-862ae9b2d476 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:38.652881 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-871bf106-0743-4e09-b6bd-862ae9b2d476 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:38.653361 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-871bf106-0743-4e09-b6bd-862ae9b2d476 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:38.654071 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-871bf106-0743-4e09-b6bd-862ae9b2d476 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:38.654538 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-871bf106-0743-4e09-b6bd-862ae9b2d476 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:38.654979 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-871bf106-0743-4e09-b6bd-862ae9b2d476 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:38.879279 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-871bf106-0743-4e09-b6bd-862ae9b2d476 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:38.889795 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-871bf106-0743-4e09-b6bd-862ae9b2d476 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1368 microversion: 2.1 time: 0.249921 Sep 19 17:39:38.891209 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 595/1180] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:38 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:39.915517 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4f089d72-14d7-4954-ab1c-fa0e76e52c65 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:39.916302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4f089d72-14d7-4954-ab1c-fa0e76e52c65 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:39.923086 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f089d72-14d7-4954-ab1c-fa0e76e52c65 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:39.923653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f089d72-14d7-4954-ab1c-fa0e76e52c65 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:39.924168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f089d72-14d7-4954-ab1c-fa0e76e52c65 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:39.924922 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f089d72-14d7-4954-ab1c-fa0e76e52c65 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:39.925430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f089d72-14d7-4954-ab1c-fa0e76e52c65 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:39.925908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f089d72-14d7-4954-ab1c-fa0e76e52c65 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:40.060975 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-4f089d72-14d7-4954-ab1c-fa0e76e52c65 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:40.068983 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4f089d72-14d7-4954-ab1c-fa0e76e52c65 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1368 microversion: 2.1 time: 0.159150 Sep 19 17:39:40.070052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 586/1181] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:39 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:41.091439 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ede34fce-ea8a-4368-b51d-8aa17ca5d7ef tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:41.092089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ede34fce-ea8a-4368-b51d-8aa17ca5d7ef tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:41.098545 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ede34fce-ea8a-4368-b51d-8aa17ca5d7ef tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:41.099022 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ede34fce-ea8a-4368-b51d-8aa17ca5d7ef tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:41.099459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ede34fce-ea8a-4368-b51d-8aa17ca5d7ef tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:41.100176 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ede34fce-ea8a-4368-b51d-8aa17ca5d7ef tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:41.101145 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ede34fce-ea8a-4368-b51d-8aa17ca5d7ef tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:41.101580 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ede34fce-ea8a-4368-b51d-8aa17ca5d7ef tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:41.235089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ede34fce-ea8a-4368-b51d-8aa17ca5d7ef tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:41.242792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ede34fce-ea8a-4368-b51d-8aa17ca5d7ef tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1368 microversion: 2.1 time: 0.155174 Sep 19 17:39:41.243358 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 596/1182] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:41 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:42.268019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0c21680-4677-4c0c-826a-e4dba1ee48bb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:42.268997 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c0c21680-4677-4c0c-826a-e4dba1ee48bb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:42.275320 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0c21680-4677-4c0c-826a-e4dba1ee48bb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:42.275830 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0c21680-4677-4c0c-826a-e4dba1ee48bb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:42.276292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0c21680-4677-4c0c-826a-e4dba1ee48bb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:42.276992 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0c21680-4677-4c0c-826a-e4dba1ee48bb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:42.277441 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0c21680-4677-4c0c-826a-e4dba1ee48bb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:42.277862 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0c21680-4677-4c0c-826a-e4dba1ee48bb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:42.411038 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c0c21680-4677-4c0c-826a-e4dba1ee48bb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:42.419472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c0c21680-4677-4c0c-826a-e4dba1ee48bb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1368 microversion: 2.1 time: 0.155425 Sep 19 17:39:42.420109 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 587/1183] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:42 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:39:43.442890 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-92c10316-ceee-44fb-8510-9b9c31b3d37d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:43.443511 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-92c10316-ceee-44fb-8510-9b9c31b3d37d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:43.446125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:39:43.451028 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92c10316-ceee-44fb-8510-9b9c31b3d37d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:43.451527 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92c10316-ceee-44fb-8510-9b9c31b3d37d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:43.452002 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92c10316-ceee-44fb-8510-9b9c31b3d37d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:43.452714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92c10316-ceee-44fb-8510-9b9c31b3d37d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:43.453175 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92c10316-ceee-44fb-8510-9b9c31b3d37d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:43.453608 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92c10316-ceee-44fb-8510-9b9c31b3d37d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:43.457826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:39:43.586151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-92c10316-ceee-44fb-8510-9b9c31b3d37d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:43.593860 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-92c10316-ceee-44fb-8510-9b9c31b3d37d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1368 microversion: 2.1 time: 0.154904 Sep 19 17:39:43.594518 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 597/1184] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:43 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:44.617434 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-38bba3d9-a4fe-4dbd-ae1e-23f39bc5d4e4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:44.618124 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-38bba3d9-a4fe-4dbd-ae1e-23f39bc5d4e4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:44.620392 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:39:44.625205 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38bba3d9-a4fe-4dbd-ae1e-23f39bc5d4e4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:44.625687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38bba3d9-a4fe-4dbd-ae1e-23f39bc5d4e4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:44.626120 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38bba3d9-a4fe-4dbd-ae1e-23f39bc5d4e4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:44.626976 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38bba3d9-a4fe-4dbd-ae1e-23f39bc5d4e4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:44.627347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38bba3d9-a4fe-4dbd-ae1e-23f39bc5d4e4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:44.627789 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38bba3d9-a4fe-4dbd-ae1e-23f39bc5d4e4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:44.760682 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-38bba3d9-a4fe-4dbd-ae1e-23f39bc5d4e4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:44.768402 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-38bba3d9-a4fe-4dbd-ae1e-23f39bc5d4e4 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1368 microversion: 2.1 time: 0.155029 Sep 19 17:39:44.768975 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 588/1185] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:44 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:45.589596 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:39:45.590422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:39:45.707927 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6936398f-edde-48ff-86a6-d52f61f77e3e req-60968f12-8ff6-4263-a7c8-1ab976d02489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52bff58-e6e4-4669-8acf-02750b2072d2", "name": "network-vif-plugged", "status": "completed", "tag": "f770338d-09a8-4720-8326-afeefa1e6b3e"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:39:45.718455 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6936398f-edde-48ff-86a6-d52f61f77e3e req-60968f12-8ff6-4263-a7c8-1ab976d02489 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:45.718764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6936398f-edde-48ff-86a6-d52f61f77e3e req-60968f12-8ff6-4263-a7c8-1ab976d02489 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:45.719200 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6936398f-edde-48ff-86a6-d52f61f77e3e req-60968f12-8ff6-4263-a7c8-1ab976d02489 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:45.732125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6936398f-edde-48ff-86a6-d52f61f77e3e req-60968f12-8ff6-4263-a7c8-1ab976d02489 service nova] Creating event network-vif-plugged:f770338d-09a8-4720-8326-afeefa1e6b3e for instance f52bff58-e6e4-4669-8acf-02750b2072d2 on hv-cinder-84801 Sep 19 17:39:45.737452 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6936398f-edde-48ff-86a6-d52f61f77e3e req-60968f12-8ff6-4263-a7c8-1ab976d02489 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152865 Sep 19 17:39:45.738090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 598/1186] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:39:45.792553 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1e445aaf-136a-4264-a88b-60fda172618f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:45.793165 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1e445aaf-136a-4264-a88b-60fda172618f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:45.800673 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e445aaf-136a-4264-a88b-60fda172618f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:45.801157 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e445aaf-136a-4264-a88b-60fda172618f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:45.801663 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e445aaf-136a-4264-a88b-60fda172618f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:45.802381 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e445aaf-136a-4264-a88b-60fda172618f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:45.802845 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e445aaf-136a-4264-a88b-60fda172618f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:45.803276 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e445aaf-136a-4264-a88b-60fda172618f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:45.936018 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-1e445aaf-136a-4264-a88b-60fda172618f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:45.946782 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1e445aaf-136a-4264-a88b-60fda172618f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1368 microversion: 2.1 time: 0.159142 Sep 19 17:39:45.947356 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 589/1187] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:45 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:46.972332 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4723728d-bb88-4de3-bbe9-bda475780208 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:46.973033 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4723728d-bb88-4de3-bbe9-bda475780208 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:46.980181 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4723728d-bb88-4de3-bbe9-bda475780208 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:46.980717 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4723728d-bb88-4de3-bbe9-bda475780208 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:46.981141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4723728d-bb88-4de3-bbe9-bda475780208 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:46.981834 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4723728d-bb88-4de3-bbe9-bda475780208 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:46.982286 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4723728d-bb88-4de3-bbe9-bda475780208 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:46.982713 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4723728d-bb88-4de3-bbe9-bda475780208 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:47.135112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4723728d-bb88-4de3-bbe9-bda475780208 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:47.144810 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4723728d-bb88-4de3-bbe9-bda475780208 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1368 microversion: 2.1 time: 0.178029 Sep 19 17:39:47.145390 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 599/1188] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:46 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:48.167997 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95ab04e3-623b-452f-bc6c-208d7c4c228a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:48.168603 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-95ab04e3-623b-452f-bc6c-208d7c4c228a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:48.175191 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95ab04e3-623b-452f-bc6c-208d7c4c228a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:48.175870 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95ab04e3-623b-452f-bc6c-208d7c4c228a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:48.176209 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95ab04e3-623b-452f-bc6c-208d7c4c228a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:48.176910 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95ab04e3-623b-452f-bc6c-208d7c4c228a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:48.177270 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95ab04e3-623b-452f-bc6c-208d7c4c228a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:48.177690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95ab04e3-623b-452f-bc6c-208d7c4c228a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:48.310541 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-95ab04e3-623b-452f-bc6c-208d7c4c228a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:48.318528 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95ab04e3-623b-452f-bc6c-208d7c4c228a tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1368 microversion: 2.1 time: 0.154488 Sep 19 17:39:48.319101 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 590/1189] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:48 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:49.342179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-34b17810-02f1-440a-b29d-dcc8109ad14e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:49.342826 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-34b17810-02f1-440a-b29d-dcc8109ad14e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:49.349308 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34b17810-02f1-440a-b29d-dcc8109ad14e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:49.349789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34b17810-02f1-440a-b29d-dcc8109ad14e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:49.350229 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34b17810-02f1-440a-b29d-dcc8109ad14e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:49.350924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34b17810-02f1-440a-b29d-dcc8109ad14e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:49.351377 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34b17810-02f1-440a-b29d-dcc8109ad14e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:49.351867 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34b17810-02f1-440a-b29d-dcc8109ad14e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:49.482261 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-34b17810-02f1-440a-b29d-dcc8109ad14e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:39:49.489953 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-34b17810-02f1-440a-b29d-dcc8109ad14e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1557 microversion: 2.1 time: 0.151760 Sep 19 17:39:49.490516 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 600/1190] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:39:49 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:39:49.513742 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-553b9131-28f9-4b8e-9819-08f996ed7da9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:39:49.514299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-553b9131-28f9-4b8e-9819-08f996ed7da9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:39:49.520176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-553b9131-28f9-4b8e-9819-08f996ed7da9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:49.520650 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-553b9131-28f9-4b8e-9819-08f996ed7da9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:49.521079 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-553b9131-28f9-4b8e-9819-08f996ed7da9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:49.521757 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-553b9131-28f9-4b8e-9819-08f996ed7da9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:49.522203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-553b9131-28f9-4b8e-9819-08f996ed7da9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:49.522620 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-553b9131-28f9-4b8e-9819-08f996ed7da9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:49.599407 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-553b9131-28f9-4b8e-9819-08f996ed7da9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089628 Sep 19 17:39:49.600062 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 591/1191] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Sep 19 17:39:49 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:39:50.819949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-9cd08d62-c799-4923-be07-8bf8e3779d58 req-b05343cb-0c55-489a-b9b1-0693d6e5a460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f52bff58-e6e4-4669-8acf-02750b2072d2", "tag": "f770338d-09a8-4720-8326-afeefa1e6b3e"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:39:50.830561 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9cd08d62-c799-4923-be07-8bf8e3779d58 req-b05343cb-0c55-489a-b9b1-0693d6e5a460 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:39:50.831141 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9cd08d62-c799-4923-be07-8bf8e3779d58 req-b05343cb-0c55-489a-b9b1-0693d6e5a460 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:39:50.831653 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9cd08d62-c799-4923-be07-8bf8e3779d58 req-b05343cb-0c55-489a-b9b1-0693d6e5a460 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:39:50.843606 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-9cd08d62-c799-4923-be07-8bf8e3779d58 req-b05343cb-0c55-489a-b9b1-0693d6e5a460 service nova] Creating event network-changed:f770338d-09a8-4720-8326-afeefa1e6b3e for instance f52bff58-e6e4-4669-8acf-02750b2072d2 on hv-cinder-84801 Sep 19 17:39:50.848675 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-9cd08d62-c799-4923-be07-8bf8e3779d58 req-b05343cb-0c55-489a-b9b1-0693d6e5a460 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032435 Sep 19 17:39:50.849458 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 601/1192] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:40:24.548329 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:40:24.548941 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=84 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:40:24.552609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-005cb13f-1829-43ae-bd55-c3a28bc86123 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:24.553104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-005cb13f-1829-43ae-bd55-c3a28bc86123 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:24.558855 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-005cb13f-1829-43ae-bd55-c3a28bc86123 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:24.559333 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-005cb13f-1829-43ae-bd55-c3a28bc86123 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:24.559791 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-005cb13f-1829-43ae-bd55-c3a28bc86123 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:24.560479 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-005cb13f-1829-43ae-bd55-c3a28bc86123 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:24.560927 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-005cb13f-1829-43ae-bd55-c3a28bc86123 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:24.561359 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-005cb13f-1829-43ae-bd55-c3a28bc86123 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:24.587556 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-005cb13f-1829-43ae-bd55-c3a28bc86123 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:40:24.910225 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-005cb13f-1829-43ae-bd55-c3a28bc86123 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "DELETE /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 204 len: 0 microversion: 2.1 time: 0.363451 Sep 19 17:40:24.910910 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 592/1193] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:40:24 2022] DELETE /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:40:24.917920 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=9 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:40:24.918720 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=21 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:40:24.922936 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cea2f1b0-b801-4914-86f6-209d760feb3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:24.924451 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cea2f1b0-b801-4914-86f6-209d760feb3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:24.929732 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea2f1b0-b801-4914-86f6-209d760feb3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:24.930248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea2f1b0-b801-4914-86f6-209d760feb3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:24.930696 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea2f1b0-b801-4914-86f6-209d760feb3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:24.931401 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea2f1b0-b801-4914-86f6-209d760feb3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:24.931896 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea2f1b0-b801-4914-86f6-209d760feb3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:24.932331 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea2f1b0-b801-4914-86f6-209d760feb3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:25.064341 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-cea2f1b0-b801-4914-86f6-209d760feb3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:25.072432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cea2f1b0-b801-4914-86f6-209d760feb3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1578 microversion: 2.1 time: 0.156240 Sep 19 17:40:25.073000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 602/1194] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:24 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:26.096238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7fdb09ba-ceba-412c-a460-ef8247082a4f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:26.096947 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7fdb09ba-ceba-412c-a460-ef8247082a4f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:26.103528 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fdb09ba-ceba-412c-a460-ef8247082a4f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:26.104057 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fdb09ba-ceba-412c-a460-ef8247082a4f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:26.104506 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fdb09ba-ceba-412c-a460-ef8247082a4f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:26.105203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fdb09ba-ceba-412c-a460-ef8247082a4f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:26.105662 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fdb09ba-ceba-412c-a460-ef8247082a4f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:26.106092 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fdb09ba-ceba-412c-a460-ef8247082a4f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:26.242693 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7fdb09ba-ceba-412c-a460-ef8247082a4f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:26.250714 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7fdb09ba-ceba-412c-a460-ef8247082a4f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1578 microversion: 2.1 time: 0.158775 Sep 19 17:40:26.251420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 593/1195] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:26 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:27.277102 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6ef8f735-5528-475c-a41e-598fe6641585 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:27.277772 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6ef8f735-5528-475c-a41e-598fe6641585 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:27.284481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ef8f735-5528-475c-a41e-598fe6641585 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:27.284969 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ef8f735-5528-475c-a41e-598fe6641585 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:27.285411 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ef8f735-5528-475c-a41e-598fe6641585 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:27.286119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ef8f735-5528-475c-a41e-598fe6641585 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:27.286576 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ef8f735-5528-475c-a41e-598fe6641585 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:27.287006 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ef8f735-5528-475c-a41e-598fe6641585 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:27.422950 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6ef8f735-5528-475c-a41e-598fe6641585 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:27.435418 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ef8f735-5528-475c-a41e-598fe6641585 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1578 microversion: 2.1 time: 0.164449 Sep 19 17:40:27.436116 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 603/1196] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:27 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:28.178935 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-20e4cc08-0d14-4ce8-88c0-92cfe5739871 req-a536157b-508f-4a76-b179-6a12fb1afe75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf0413e-fde3-4cb9-bed3-1dd053a94609", "name": "network-vif-deleted", "tag": "ceaaa721-b6be-4326-b3ea-f412d7f7f544"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:40:28.188733 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-20e4cc08-0d14-4ce8-88c0-92cfe5739871 req-a536157b-508f-4a76-b179-6a12fb1afe75 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:28.189199 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-20e4cc08-0d14-4ce8-88c0-92cfe5739871 req-a536157b-508f-4a76-b179-6a12fb1afe75 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:28.189635 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-20e4cc08-0d14-4ce8-88c0-92cfe5739871 req-a536157b-508f-4a76-b179-6a12fb1afe75 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:28.201129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-20e4cc08-0d14-4ce8-88c0-92cfe5739871 req-a536157b-508f-4a76-b179-6a12fb1afe75 service nova] Creating event network-vif-deleted:ceaaa721-b6be-4326-b3ea-f412d7f7f544 for instance faf0413e-fde3-4cb9-bed3-1dd053a94609 on hv-cinder-84801 Sep 19 17:40:28.206416 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-20e4cc08-0d14-4ce8-88c0-92cfe5739871 req-a536157b-508f-4a76-b179-6a12fb1afe75 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142709 Sep 19 17:40:28.207029 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 594/1197] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:40:28.461413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9ef74b8f-ec6d-44f1-b548-76657a449dd6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:28.462464 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9ef74b8f-ec6d-44f1-b548-76657a449dd6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:28.471054 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ef74b8f-ec6d-44f1-b548-76657a449dd6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:28.472625 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ef74b8f-ec6d-44f1-b548-76657a449dd6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:28.473258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ef74b8f-ec6d-44f1-b548-76657a449dd6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:28.474261 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ef74b8f-ec6d-44f1-b548-76657a449dd6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:28.474976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ef74b8f-ec6d-44f1-b548-76657a449dd6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:28.476260 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ef74b8f-ec6d-44f1-b548-76657a449dd6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:28.552318 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ef74b8f-ec6d-44f1-b548-76657a449dd6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:28.561389 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9ef74b8f-ec6d-44f1-b548-76657a449dd6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1225 microversion: 2.1 time: 0.105022 Sep 19 17:40:28.569354 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 604/1198] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:28 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:29.587020 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:29.587638 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:29.594161 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:29.594652 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:29.595098 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:29.595837 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:29.596297 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:29.596734 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:29.629644 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:29.630058 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:29.630502 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:29.630956 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lazy-loading 'fault' on Instance uuid faf0413e-fde3-4cb9-bed3-1dd053a94609 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:40:29.679625 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:29.688101 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4efd5869-a892-4d1d-aa02-c37ad8a22bd9 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 200 len: 1230 microversion: 2.1 time: 0.106855 Sep 19 17:40:29.688709 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 595/1199] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:29 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:30.712604 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:30.713168 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:30.719603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:30.720124 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:30.720564 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:30.721270 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:30.721724 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:30.722151 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:30.735956 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] HTTP exception thrown: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Request method failure captured: Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 HTTP/1.1 Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKiybqyYga1n069x7flHG0C2cPmJ9EaKtkMsTflMdBA_aEZBYLi0Vtask6794lcunovSFC8oV9h6emEgXFRb-sk5x2kR_U4BFzeHywBvAGqgtFx2YGWHV6GBCVX0V1bcBUoNx6WQEpVq24HksaEWuquFv-aKzpKziGS7OayWaRpR8C8 Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 3fa7a842679b460f87e34a84e7d12c5f Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-TestVolumeBootPattern-428104274 Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:40:30.737586 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3fa7a842679b460f87e34a84e7d12c5f"}]}] Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-TestVolumeBootPattern-428104274 Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 3fa7a842679b460f87e34a84e7d12c5f Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestVolumeBootPattern-428104274 Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-TestVolumeBootPattern-428104274-project Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: a695d9e178414ba294fc30fe12edf7aa Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-TestVolumeBootPattern-428104274-project Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:40:30.740385 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': 'faf0413e-fde3-4cb9-bed3-1dd053a94609'} Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:40:30.741985 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:40:30.744481 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:40:30.746649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Returning 404 to user: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:40:30.746649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-820413e0-e1d4-413c-add1-8ecf819f0252 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 404 len: 111 microversion: 2.1 time: 0.030922 Sep 19 17:40:30.746649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 605/1200] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:30 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:40:30.835432 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-678510109", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1139086849", "security_groups": [{"name": "tempest-secgroup-smoke-1369752678"}], "block_device_mapping_v2": [{"uuid": "92dede58-5c14-4bee-9363-207643830d2b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1590abdf-b953-4897-85f6-bffe0b292150"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:40:30.952326 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] validate_networks() for [('1590abdf-b953-4897-85f6-bffe0b292150', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:40:31.396076 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:40:31.396504 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:40:31.396987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:40:31.398009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:40:31.398457 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:40:31.408626 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:31.409109 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:31.409549 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:31.410281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:31.410744 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:31.411176 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:31.428074 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Getting quotas for project 3fa7a842679b460f87e34a84e7d12c5f. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:40:31.432552 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Getting quotas for user a695d9e178414ba294fc30fe12edf7aa and project 3fa7a842679b460f87e34a84e7d12c5f. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:40:31.489666 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:40:31.492310 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92dede58-5c14-4bee-9363-207643830d2b',volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:40:31.978446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [3d349a27-efa8-4350-8176-46e5726e9fe6] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 17:40:32.985871 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [3d349a27-efa8-4350-8176-46e5726e9fe6] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 52158. Sep 19 17:40:32.989656 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-18937050-335d-48d4-ae13-dc2b55756b21 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.158668 Sep 19 17:40:32.990316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 596/1201] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:40:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 2160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:40:33.001992 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9f90d228-1cb9-4479-91f1-2069da72bdc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:33.002613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9f90d228-1cb9-4479-91f1-2069da72bdc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:33.057018 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9f90d228-1cb9-4479-91f1-2069da72bdc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:33.064877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9f90d228-1cb9-4479-91f1-2069da72bdc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1094 microversion: 2.1 time: 0.066690 Sep 19 17:40:33.065499 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 606/1202] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:32 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:34.089816 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-619d2e9c-cc08-4579-8896-48efa7455bfd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:34.090444 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-619d2e9c-cc08-4579-8896-48efa7455bfd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:34.096962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-619d2e9c-cc08-4579-8896-48efa7455bfd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:34.097457 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-619d2e9c-cc08-4579-8896-48efa7455bfd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:34.097903 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-619d2e9c-cc08-4579-8896-48efa7455bfd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:34.098619 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-619d2e9c-cc08-4579-8896-48efa7455bfd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:34.099079 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-619d2e9c-cc08-4579-8896-48efa7455bfd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:34.099582 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-619d2e9c-cc08-4579-8896-48efa7455bfd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:34.164685 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-619d2e9c-cc08-4579-8896-48efa7455bfd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:34.172847 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-619d2e9c-cc08-4579-8896-48efa7455bfd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1144 microversion: 2.1 time: 0.088134 Sep 19 17:40:34.173584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 597/1203] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:34 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:35.196211 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d7f19385-a277-4716-9c00-4017bbd84b9d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:35.196839 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d7f19385-a277-4716-9c00-4017bbd84b9d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:35.203332 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7f19385-a277-4716-9c00-4017bbd84b9d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:35.207309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7f19385-a277-4716-9c00-4017bbd84b9d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:35.207309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7f19385-a277-4716-9c00-4017bbd84b9d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:35.207309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7f19385-a277-4716-9c00-4017bbd84b9d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:35.207309 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7f19385-a277-4716-9c00-4017bbd84b9d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:35.207750 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7f19385-a277-4716-9c00-4017bbd84b9d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:35.273995 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d7f19385-a277-4716-9c00-4017bbd84b9d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:35.283722 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d7f19385-a277-4716-9c00-4017bbd84b9d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1200 microversion: 2.1 time: 0.091479 Sep 19 17:40:35.290274 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 607/1204] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:35 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:36.309025 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a69493c-1518-41db-93dd-f707842a7c8b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:36.309025 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a69493c-1518-41db-93dd-f707842a7c8b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:36.315144 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a69493c-1518-41db-93dd-f707842a7c8b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:36.315623 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a69493c-1518-41db-93dd-f707842a7c8b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:36.316091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a69493c-1518-41db-93dd-f707842a7c8b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:36.316784 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a69493c-1518-41db-93dd-f707842a7c8b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:36.317239 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a69493c-1518-41db-93dd-f707842a7c8b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:36.317665 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a69493c-1518-41db-93dd-f707842a7c8b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:36.457689 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a69493c-1518-41db-93dd-f707842a7c8b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:36.466194 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a69493c-1518-41db-93dd-f707842a7c8b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1278 microversion: 2.1 time: 0.162574 Sep 19 17:40:36.466807 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 598/1205] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:36 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:36.785470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-421149b1-e7de-4c45-b793-fe0700451c31 req-d2204c70-288f-486d-8634-34d8e0e1817a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "426d62ae-f3df-4fac-ae8c-a46f474ae96f", "tag": "727823c4-0505-44bd-b537-7bd995c24817"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:40:36.795986 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-421149b1-e7de-4c45-b793-fe0700451c31 req-d2204c70-288f-486d-8634-34d8e0e1817a service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:36.796467 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-421149b1-e7de-4c45-b793-fe0700451c31 req-d2204c70-288f-486d-8634-34d8e0e1817a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:36.799949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-421149b1-e7de-4c45-b793-fe0700451c31 req-d2204c70-288f-486d-8634-34d8e0e1817a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:36.808264 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-421149b1-e7de-4c45-b793-fe0700451c31 req-d2204c70-288f-486d-8634-34d8e0e1817a service nova] Creating event network-changed:727823c4-0505-44bd-b537-7bd995c24817 for instance 426d62ae-f3df-4fac-ae8c-a46f474ae96f on hv-cinder-84801 Sep 19 17:40:36.814550 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-421149b1-e7de-4c45-b793-fe0700451c31 req-d2204c70-288f-486d-8634-34d8e0e1817a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032846 Sep 19 17:40:36.815478 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 608/1206] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:40:37.490334 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-981d7894-24e3-4ac7-ba0e-0454ad1e804f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:37.502379 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-981d7894-24e3-4ac7-ba0e-0454ad1e804f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:37.509425 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-981d7894-24e3-4ac7-ba0e-0454ad1e804f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:37.510040 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-981d7894-24e3-4ac7-ba0e-0454ad1e804f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:37.510494 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-981d7894-24e3-4ac7-ba0e-0454ad1e804f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:37.511266 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-981d7894-24e3-4ac7-ba0e-0454ad1e804f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:37.511879 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-981d7894-24e3-4ac7-ba0e-0454ad1e804f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:37.512349 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-981d7894-24e3-4ac7-ba0e-0454ad1e804f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:37.644725 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-981d7894-24e3-4ac7-ba0e-0454ad1e804f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:37.653060 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-981d7894-24e3-4ac7-ba0e-0454ad1e804f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.166597 Sep 19 17:40:37.659846 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 599/1207] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:37 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:38.677922 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3f2eb43-9ccb-4954-8b01-2f1200edffc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:38.678522 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3f2eb43-9ccb-4954-8b01-2f1200edffc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:38.685328 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f2eb43-9ccb-4954-8b01-2f1200edffc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:38.685819 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f2eb43-9ccb-4954-8b01-2f1200edffc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:38.686266 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f2eb43-9ccb-4954-8b01-2f1200edffc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:38.686972 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f2eb43-9ccb-4954-8b01-2f1200edffc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:38.687437 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f2eb43-9ccb-4954-8b01-2f1200edffc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:38.687905 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f2eb43-9ccb-4954-8b01-2f1200edffc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:38.823087 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3f2eb43-9ccb-4954-8b01-2f1200edffc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:38.830995 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a3f2eb43-9ccb-4954-8b01-2f1200edffc5 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.157885 Sep 19 17:40:38.831560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 609/1208] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:38 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:39.853653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-99c2259a-b8a6-4b32-a93c-45c51ce3f37c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:39.854302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-99c2259a-b8a6-4b32-a93c-45c51ce3f37c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:39.860870 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99c2259a-b8a6-4b32-a93c-45c51ce3f37c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:39.861347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99c2259a-b8a6-4b32-a93c-45c51ce3f37c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:39.861782 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99c2259a-b8a6-4b32-a93c-45c51ce3f37c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:39.862463 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99c2259a-b8a6-4b32-a93c-45c51ce3f37c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:39.862911 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99c2259a-b8a6-4b32-a93c-45c51ce3f37c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:39.863331 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99c2259a-b8a6-4b32-a93c-45c51ce3f37c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:39.994009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-99c2259a-b8a6-4b32-a93c-45c51ce3f37c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:40.001573 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-99c2259a-b8a6-4b32-a93c-45c51ce3f37c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.151824 Sep 19 17:40:40.002139 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 600/1209] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:39 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:41.024433 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ef014937-1284-453e-b6f9-bd1b944143bd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:41.025054 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ef014937-1284-453e-b6f9-bd1b944143bd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:41.031028 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef014937-1284-453e-b6f9-bd1b944143bd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:41.031511 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef014937-1284-453e-b6f9-bd1b944143bd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:41.031989 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef014937-1284-453e-b6f9-bd1b944143bd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:41.032693 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef014937-1284-453e-b6f9-bd1b944143bd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:41.033152 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef014937-1284-453e-b6f9-bd1b944143bd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:41.033587 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef014937-1284-453e-b6f9-bd1b944143bd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:41.164192 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ef014937-1284-453e-b6f9-bd1b944143bd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:41.172434 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ef014937-1284-453e-b6f9-bd1b944143bd tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.152096 Sep 19 17:40:41.172999 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 610/1210] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:41 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:42.194270 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7f4f790-ac91-42d9-a9bc-a29a0194621e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:42.194892 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b7f4f790-ac91-42d9-a9bc-a29a0194621e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:42.197900 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:40:42.198738 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:40:42.203471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7f4f790-ac91-42d9-a9bc-a29a0194621e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:42.204028 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7f4f790-ac91-42d9-a9bc-a29a0194621e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:42.204471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7f4f790-ac91-42d9-a9bc-a29a0194621e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:42.210230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7f4f790-ac91-42d9-a9bc-a29a0194621e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:42.210230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7f4f790-ac91-42d9-a9bc-a29a0194621e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:42.210230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7f4f790-ac91-42d9-a9bc-a29a0194621e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:42.336803 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b7f4f790-ac91-42d9-a9bc-a29a0194621e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:42.344462 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b7f4f790-ac91-42d9-a9bc-a29a0194621e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.154037 Sep 19 17:40:42.345040 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 601/1211] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:42 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:43.368629 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a966e2b-0faf-4df4-9a2c-405f4717f2db tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:43.369188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a966e2b-0faf-4df4-9a2c-405f4717f2db tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:43.371634 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:40:43.376408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a966e2b-0faf-4df4-9a2c-405f4717f2db tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:43.376895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a966e2b-0faf-4df4-9a2c-405f4717f2db tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:43.377338 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a966e2b-0faf-4df4-9a2c-405f4717f2db tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:43.378032 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a966e2b-0faf-4df4-9a2c-405f4717f2db tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:43.378486 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a966e2b-0faf-4df4-9a2c-405f4717f2db tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:43.379170 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a966e2b-0faf-4df4-9a2c-405f4717f2db tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:43.510712 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a966e2b-0faf-4df4-9a2c-405f4717f2db tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:43.518619 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a966e2b-0faf-4df4-9a2c-405f4717f2db tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.154422 Sep 19 17:40:43.519060 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 611/1212] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:43 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:44.541857 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-35baa562-539f-40b7-ae9f-710aa790ac17 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:44.548322 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-35baa562-539f-40b7-ae9f-710aa790ac17 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:44.548953 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35baa562-539f-40b7-ae9f-710aa790ac17 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:44.549439 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35baa562-539f-40b7-ae9f-710aa790ac17 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:44.549884 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35baa562-539f-40b7-ae9f-710aa790ac17 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:44.550580 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35baa562-539f-40b7-ae9f-710aa790ac17 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:44.551036 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35baa562-539f-40b7-ae9f-710aa790ac17 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:44.551469 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35baa562-539f-40b7-ae9f-710aa790ac17 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:44.688241 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-35baa562-539f-40b7-ae9f-710aa790ac17 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:44.696584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-35baa562-539f-40b7-ae9f-710aa790ac17 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.158129 Sep 19 17:40:44.697158 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 602/1213] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:44 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:45.720486 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aeb51083-5c51-43f5-b656-130fc99be55d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:45.721099 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aeb51083-5c51-43f5-b656-130fc99be55d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:45.727759 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeb51083-5c51-43f5-b656-130fc99be55d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:45.728254 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeb51083-5c51-43f5-b656-130fc99be55d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:45.728745 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeb51083-5c51-43f5-b656-130fc99be55d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:45.729464 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeb51083-5c51-43f5-b656-130fc99be55d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:45.729925 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeb51083-5c51-43f5-b656-130fc99be55d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:45.730355 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeb51083-5c51-43f5-b656-130fc99be55d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:45.870794 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-aeb51083-5c51-43f5-b656-130fc99be55d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:45.879097 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aeb51083-5c51-43f5-b656-130fc99be55d tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.162296 Sep 19 17:40:45.879714 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 612/1214] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:45 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:46.903221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8e0a08c-09da-4427-9594-dd2cf47784b6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:46.903861 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8e0a08c-09da-4427-9594-dd2cf47784b6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:46.910339 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8e0a08c-09da-4427-9594-dd2cf47784b6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:46.910828 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8e0a08c-09da-4427-9594-dd2cf47784b6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:46.911274 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8e0a08c-09da-4427-9594-dd2cf47784b6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:46.911997 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8e0a08c-09da-4427-9594-dd2cf47784b6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:46.912465 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8e0a08c-09da-4427-9594-dd2cf47784b6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:46.912892 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8e0a08c-09da-4427-9594-dd2cf47784b6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:47.062360 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8e0a08c-09da-4427-9594-dd2cf47784b6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:47.073923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8e0a08c-09da-4427-9594-dd2cf47784b6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.174740 Sep 19 17:40:47.074942 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 603/1215] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:46 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:48.104353 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aa2f8455-a28b-41b8-92bb-43b5bec53854 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:48.105121 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aa2f8455-a28b-41b8-92bb-43b5bec53854 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:48.111403 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa2f8455-a28b-41b8-92bb-43b5bec53854 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:48.111932 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa2f8455-a28b-41b8-92bb-43b5bec53854 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:48.112378 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa2f8455-a28b-41b8-92bb-43b5bec53854 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:48.113079 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa2f8455-a28b-41b8-92bb-43b5bec53854 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:48.113536 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa2f8455-a28b-41b8-92bb-43b5bec53854 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:48.113961 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa2f8455-a28b-41b8-92bb-43b5bec53854 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:48.245650 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-aa2f8455-a28b-41b8-92bb-43b5bec53854 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:48.253325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aa2f8455-a28b-41b8-92bb-43b5bec53854 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.152849 Sep 19 17:40:48.254149 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 613/1216] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:48 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:40:49.277746 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7de14080-5b8f-48e2-9160-fad87bcfe9a2 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:49.278380 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7de14080-5b8f-48e2-9160-fad87bcfe9a2 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:49.285402 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de14080-5b8f-48e2-9160-fad87bcfe9a2 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:49.285892 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de14080-5b8f-48e2-9160-fad87bcfe9a2 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:49.286353 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de14080-5b8f-48e2-9160-fad87bcfe9a2 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:49.287023 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de14080-5b8f-48e2-9160-fad87bcfe9a2 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:49.287485 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de14080-5b8f-48e2-9160-fad87bcfe9a2 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:49.287942 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de14080-5b8f-48e2-9160-fad87bcfe9a2 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:49.417969 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-7de14080-5b8f-48e2-9160-fad87bcfe9a2 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:49.425523 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7de14080-5b8f-48e2-9160-fad87bcfe9a2 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.152404 Sep 19 17:40:49.426116 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 604/1217] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:49 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:50.004064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-9c0bf5e6-0d82-4c88-b2a5-f573afb4ee9f req-10a7a354-d3ff-40ea-ab52-d219c72ed20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "426d62ae-f3df-4fac-ae8c-a46f474ae96f", "name": "network-vif-plugged", "status": "completed", "tag": "727823c4-0505-44bd-b537-7bd995c24817"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:40:50.013829 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9c0bf5e6-0d82-4c88-b2a5-f573afb4ee9f req-10a7a354-d3ff-40ea-ab52-d219c72ed20a service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:50.018027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9c0bf5e6-0d82-4c88-b2a5-f573afb4ee9f req-10a7a354-d3ff-40ea-ab52-d219c72ed20a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:50.018027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9c0bf5e6-0d82-4c88-b2a5-f573afb4ee9f req-10a7a354-d3ff-40ea-ab52-d219c72ed20a service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:50.025427 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-9c0bf5e6-0d82-4c88-b2a5-f573afb4ee9f req-10a7a354-d3ff-40ea-ab52-d219c72ed20a service nova] Creating event network-vif-plugged:727823c4-0505-44bd-b537-7bd995c24817 for instance 426d62ae-f3df-4fac-ae8c-a46f474ae96f on hv-cinder-84801 Sep 19 17:40:50.031218 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-9c0bf5e6-0d82-4c88-b2a5-f573afb4ee9f req-10a7a354-d3ff-40ea-ab52-d219c72ed20a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031006 Sep 19 17:40:50.031764 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 614/1218] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:40:50.447437 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-600945f1-ff42-41a1-8391-430e642035fb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:50.448759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-600945f1-ff42-41a1-8391-430e642035fb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:50.455174 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-600945f1-ff42-41a1-8391-430e642035fb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:50.455665 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-600945f1-ff42-41a1-8391-430e642035fb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:50.456143 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-600945f1-ff42-41a1-8391-430e642035fb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:50.456853 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-600945f1-ff42-41a1-8391-430e642035fb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:50.457316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-600945f1-ff42-41a1-8391-430e642035fb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:50.457748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-600945f1-ff42-41a1-8391-430e642035fb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:50.592350 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-600945f1-ff42-41a1-8391-430e642035fb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:50.600162 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-600945f1-ff42-41a1-8391-430e642035fb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.156619 Sep 19 17:40:50.600732 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 605/1219] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:50 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:51.623140 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf7151ae-df59-4b0b-8aca-8e5964651dc7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:51.623783 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cf7151ae-df59-4b0b-8aca-8e5964651dc7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:51.630805 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf7151ae-df59-4b0b-8aca-8e5964651dc7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:51.631290 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf7151ae-df59-4b0b-8aca-8e5964651dc7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:51.631761 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf7151ae-df59-4b0b-8aca-8e5964651dc7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:51.632460 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf7151ae-df59-4b0b-8aca-8e5964651dc7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:51.632918 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf7151ae-df59-4b0b-8aca-8e5964651dc7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:51.633349 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf7151ae-df59-4b0b-8aca-8e5964651dc7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:51.766769 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-cf7151ae-df59-4b0b-8aca-8e5964651dc7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:51.774726 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cf7151ae-df59-4b0b-8aca-8e5964651dc7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1266 microversion: 2.1 time: 0.155808 Sep 19 17:40:51.775376 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 615/1220] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:51 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:52.800369 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58add578-1ae2-4c6d-8753-dab24803781f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:52.800915 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58add578-1ae2-4c6d-8753-dab24803781f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:52.807531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58add578-1ae2-4c6d-8753-dab24803781f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:52.808069 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58add578-1ae2-4c6d-8753-dab24803781f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:52.808507 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58add578-1ae2-4c6d-8753-dab24803781f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:52.809199 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58add578-1ae2-4c6d-8753-dab24803781f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:52.809680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58add578-1ae2-4c6d-8753-dab24803781f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:52.810105 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58add578-1ae2-4c6d-8753-dab24803781f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:52.949999 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-58add578-1ae2-4c6d-8753-dab24803781f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:52.958313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58add578-1ae2-4c6d-8753-dab24803781f tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1453 microversion: 2.1 time: 0.162030 Sep 19 17:40:52.958889 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 606/1221] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:52 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:52.980934 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dba383b9-b302-4140-ae38-ca10c6f79782 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:40:52.981539 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dba383b9-b302-4140-ae38-ca10c6f79782 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:40:52.988526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba383b9-b302-4140-ae38-ca10c6f79782 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:52.989014 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba383b9-b302-4140-ae38-ca10c6f79782 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:52.989454 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba383b9-b302-4140-ae38-ca10c6f79782 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:52.990146 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba383b9-b302-4140-ae38-ca10c6f79782 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:52.990597 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba383b9-b302-4140-ae38-ca10c6f79782 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:52.991042 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba383b9-b302-4140-ae38-ca10c6f79782 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:53.120267 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-dba383b9-b302-4140-ae38-ca10c6f79782 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:40:53.128200 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dba383b9-b302-4140-ae38-ca10c6f79782 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1453 microversion: 2.1 time: 0.151126 Sep 19 17:40:53.129022 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 616/1222] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:40:52 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:40:54.993748 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-808a9579-d1d7-430b-b04b-18be9311da81 req-9d524823-da93-46c6-b6f8-c50a6d956002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "426d62ae-f3df-4fac-ae8c-a46f474ae96f", "tag": "727823c4-0505-44bd-b537-7bd995c24817"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:40:54.999268 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:40:55.004777 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-808a9579-d1d7-430b-b04b-18be9311da81 req-9d524823-da93-46c6-b6f8-c50a6d956002 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:40:55.005257 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-808a9579-d1d7-430b-b04b-18be9311da81 req-9d524823-da93-46c6-b6f8-c50a6d956002 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:40:55.005689 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-808a9579-d1d7-430b-b04b-18be9311da81 req-9d524823-da93-46c6-b6f8-c50a6d956002 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:40:55.009538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:40:55.017462 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-808a9579-d1d7-430b-b04b-18be9311da81 req-9d524823-da93-46c6-b6f8-c50a6d956002 service nova] Creating event network-changed:727823c4-0505-44bd-b537-7bd995c24817 for instance 426d62ae-f3df-4fac-ae8c-a46f474ae96f on hv-cinder-84801 Sep 19 17:40:55.023146 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-808a9579-d1d7-430b-b04b-18be9311da81 req-9d524823-da93-46c6-b6f8-c50a6d956002 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033110 Sep 19 17:40:55.023719 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 607/1223] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:05.789088 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eb73932a-c4a9-4e71-bf7b-930b8cd3d71d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:05.789726 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eb73932a-c4a9-4e71-bf7b-930b8cd3d71d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:05.792137 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=32 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:41:05.792797 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=72 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:41:05.797455 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb73932a-c4a9-4e71-bf7b-930b8cd3d71d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:05.797935 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb73932a-c4a9-4e71-bf7b-930b8cd3d71d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:05.798372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb73932a-c4a9-4e71-bf7b-930b8cd3d71d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:05.799064 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb73932a-c4a9-4e71-bf7b-930b8cd3d71d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:05.799520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb73932a-c4a9-4e71-bf7b-930b8cd3d71d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:05.799975 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb73932a-c4a9-4e71-bf7b-930b8cd3d71d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:05.824105 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eb73932a-c4a9-4e71-bf7b-930b8cd3d71d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/ips" status: 200 len: 149 microversion: 2.1 time: 0.038858 Sep 19 17:41:05.824725 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 617/1224] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Sep 19 17:41:05 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:08.461256 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7b0e0a5b-ad8b-434d-b679-cf831b7cf472 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbab4778-99c6-4936-8cd6-68129adf4a2f"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:41:08.463658 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7b0e0a5b-ad8b-434d-b679-cf831b7cf472 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:08.472000 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b0e0a5b-ad8b-434d-b679-cf831b7cf472 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:08.472483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b0e0a5b-ad8b-434d-b679-cf831b7cf472 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:08.472918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b0e0a5b-ad8b-434d-b679-cf831b7cf472 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:08.473609 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b0e0a5b-ad8b-434d-b679-cf831b7cf472 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:08.474064 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b0e0a5b-ad8b-434d-b679-cf831b7cf472 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:08.474490 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b0e0a5b-ad8b-434d-b679-cf831b7cf472 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:09.289523 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7b0e0a5b-ad8b-434d-b679-cf831b7cf472 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "POST /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833076 Sep 19 17:41:09.290217 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 608/1225] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Sep 19 17:41:08 2022] POST /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-volume_attachments => generated 194 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:17.995214 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-62aa0749-13c9-48c3-b22a-e473c801a51b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:17.995798 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-62aa0749-13c9-48c3-b22a-e473c801a51b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:18.002248 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62aa0749-13c9-48c3-b22a-e473c801a51b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:18.003000 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62aa0749-13c9-48c3-b22a-e473c801a51b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:18.003441 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62aa0749-13c9-48c3-b22a-e473c801a51b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:18.004182 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62aa0749-13c9-48c3-b22a-e473c801a51b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:18.004661 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62aa0749-13c9-48c3-b22a-e473c801a51b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:18.005077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62aa0749-13c9-48c3-b22a-e473c801a51b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:18.084854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-62aa0749-13c9-48c3-b22a-e473c801a51b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lazy-loading 'services' on Instance uuid f52bff58-e6e4-4669-8acf-02750b2072d2 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:41:18.268236 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-62aa0749-13c9-48c3-b22a-e473c801a51b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-volume_attachments/bbab4778-99c6-4936-8cd6-68129adf4a2f" status: 202 len: 0 microversion: 2.1 time: 0.277356 Sep 19 17:41:18.268905 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 618/1226] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Sep 19 17:41:17 2022] DELETE /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-volume_attachments/bbab4778-99c6-4936-8cd6-68129adf4a2f => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:41:18.278238 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-91c75e99-9b86-4909-8ff7-cdcac796d34b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:18.280725 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-91c75e99-9b86-4909-8ff7-cdcac796d34b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:18.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c75e99-9b86-4909-8ff7-cdcac796d34b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:18.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c75e99-9b86-4909-8ff7-cdcac796d34b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:18.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c75e99-9b86-4909-8ff7-cdcac796d34b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:18.288877 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c75e99-9b86-4909-8ff7-cdcac796d34b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:18.289354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c75e99-9b86-4909-8ff7-cdcac796d34b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:18.289654 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c75e99-9b86-4909-8ff7-cdcac796d34b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:18.319874 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-91c75e99-9b86-4909-8ff7-cdcac796d34b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046415 Sep 19 17:41:18.320437 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 609/1227] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:41:18 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:41:19.334694 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ce4fc00b-d22e-4289-a068-d9f989298bfe tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:19.336868 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ce4fc00b-d22e-4289-a068-d9f989298bfe tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:19.343113 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce4fc00b-d22e-4289-a068-d9f989298bfe tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:19.343591 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce4fc00b-d22e-4289-a068-d9f989298bfe tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:19.344662 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce4fc00b-d22e-4289-a068-d9f989298bfe tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:19.345360 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce4fc00b-d22e-4289-a068-d9f989298bfe tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:19.345809 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce4fc00b-d22e-4289-a068-d9f989298bfe tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:19.346232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce4fc00b-d22e-4289-a068-d9f989298bfe tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:19.382179 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ce4fc00b-d22e-4289-a068-d9f989298bfe tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052363 Sep 19 17:41:19.382966 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 619/1228] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:41:19 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:20.394632 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e727c92-3888-4fd3-9d2d-be782fa58257 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:20.396975 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e727c92-3888-4fd3-9d2d-be782fa58257 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:20.403533 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e727c92-3888-4fd3-9d2d-be782fa58257 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:20.404048 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e727c92-3888-4fd3-9d2d-be782fa58257 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:20.404487 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e727c92-3888-4fd3-9d2d-be782fa58257 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:20.405175 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e727c92-3888-4fd3-9d2d-be782fa58257 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:20.405628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e727c92-3888-4fd3-9d2d-be782fa58257 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:20.406054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e727c92-3888-4fd3-9d2d-be782fa58257 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:20.438736 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e727c92-3888-4fd3-9d2d-be782fa58257 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047967 Sep 19 17:41:20.439314 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 610/1229] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Sep 19 17:41:20 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 17:41:20.503578 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-48f264fe-88c9-4d34-88a1-205829a4b7c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:20.504172 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-48f264fe-88c9-4d34-88a1-205829a4b7c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:20.510308 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48f264fe-88c9-4d34-88a1-205829a4b7c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:20.510786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48f264fe-88c9-4d34-88a1-205829a4b7c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:20.511220 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48f264fe-88c9-4d34-88a1-205829a4b7c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:20.511938 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48f264fe-88c9-4d34-88a1-205829a4b7c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:20.512480 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48f264fe-88c9-4d34-88a1-205829a4b7c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:20.512904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48f264fe-88c9-4d34-88a1-205829a4b7c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:20.538579 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-48f264fe-88c9-4d34-88a1-205829a4b7c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:41:20.856790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-48f264fe-88c9-4d34-88a1-205829a4b7c9 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 204 len: 0 microversion: 2.1 time: 0.356996 Sep 19 17:41:20.857431 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 620/1230] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:41:20 2022] DELETE /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:41:20.865584 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-49b0478e-f9dd-4fd3-b120-1b7e2be2913e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:20.866192 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-49b0478e-f9dd-4fd3-b120-1b7e2be2913e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:20.872200 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b0478e-f9dd-4fd3-b120-1b7e2be2913e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:20.872674 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b0478e-f9dd-4fd3-b120-1b7e2be2913e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:20.873107 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b0478e-f9dd-4fd3-b120-1b7e2be2913e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:20.873787 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b0478e-f9dd-4fd3-b120-1b7e2be2913e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:20.874233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b0478e-f9dd-4fd3-b120-1b7e2be2913e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:20.874652 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b0478e-f9dd-4fd3-b120-1b7e2be2913e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:21.008135 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-49b0478e-f9dd-4fd3-b120-1b7e2be2913e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:41:21.016449 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-49b0478e-f9dd-4fd3-b120-1b7e2be2913e tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1682 microversion: 2.1 time: 0.154137 Sep 19 17:41:21.017016 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 611/1231] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:41:20 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:41:22.040664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a30579e3-a798-4cda-8288-03cbc07a993c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:22.041529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a30579e3-a798-4cda-8288-03cbc07a993c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:22.047983 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30579e3-a798-4cda-8288-03cbc07a993c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:22.048468 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30579e3-a798-4cda-8288-03cbc07a993c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:22.048904 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30579e3-a798-4cda-8288-03cbc07a993c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:22.049594 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30579e3-a798-4cda-8288-03cbc07a993c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:22.050051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30579e3-a798-4cda-8288-03cbc07a993c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:22.050473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30579e3-a798-4cda-8288-03cbc07a993c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:22.182369 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-a30579e3-a798-4cda-8288-03cbc07a993c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:41:22.191016 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a30579e3-a798-4cda-8288-03cbc07a993c tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1682 microversion: 2.1 time: 0.154587 Sep 19 17:41:22.191587 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 621/1232] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:41:22 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:41:23.214842 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8168b18c-6886-4a4c-bcb7-21233d1c6f7b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:23.215566 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8168b18c-6886-4a4c-bcb7-21233d1c6f7b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:23.222674 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8168b18c-6886-4a4c-bcb7-21233d1c6f7b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:23.223154 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8168b18c-6886-4a4c-bcb7-21233d1c6f7b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:23.223592 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8168b18c-6886-4a4c-bcb7-21233d1c6f7b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:23.224332 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8168b18c-6886-4a4c-bcb7-21233d1c6f7b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:23.224787 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8168b18c-6886-4a4c-bcb7-21233d1c6f7b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:23.225210 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8168b18c-6886-4a4c-bcb7-21233d1c6f7b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:23.362806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-8168b18c-6886-4a4c-bcb7-21233d1c6f7b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:41:23.371878 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8168b18c-6886-4a4c-bcb7-21233d1c6f7b tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1682 microversion: 2.1 time: 0.161320 Sep 19 17:41:23.372512 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 612/1233] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:41:23 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:41:23.925526 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-96948847-89c2-4e57-81d6-7f4296f026ba req-c0dd3dff-fa11-41d2-9c23-958a6b7011db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52bff58-e6e4-4669-8acf-02750b2072d2", "name": "network-vif-deleted", "tag": "f770338d-09a8-4720-8326-afeefa1e6b3e"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:41:23.936626 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96948847-89c2-4e57-81d6-7f4296f026ba req-c0dd3dff-fa11-41d2-9c23-958a6b7011db service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:23.937106 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96948847-89c2-4e57-81d6-7f4296f026ba req-c0dd3dff-fa11-41d2-9c23-958a6b7011db service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:23.937539 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96948847-89c2-4e57-81d6-7f4296f026ba req-c0dd3dff-fa11-41d2-9c23-958a6b7011db service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:23.951356 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-96948847-89c2-4e57-81d6-7f4296f026ba req-c0dd3dff-fa11-41d2-9c23-958a6b7011db service nova] Creating event network-vif-deleted:f770338d-09a8-4720-8326-afeefa1e6b3e for instance f52bff58-e6e4-4669-8acf-02750b2072d2 on hv-cinder-84801 Sep 19 17:41:23.956577 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-96948847-89c2-4e57-81d6-7f4296f026ba req-c0dd3dff-fa11-41d2-9c23-958a6b7011db service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035430 Sep 19 17:41:23.957193 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 622/1234] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:24.395197 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:24.395895 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:24.402162 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:24.402653 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:24.403104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:24.404087 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:24.404552 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:24.404986 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:24.440080 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:24.446395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:24.446395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:24.446395 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lazy-loading 'fault' on Instance uuid f52bff58-e6e4-4669-8acf-02750b2072d2 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:41:24.485557 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e4233c03174fa18deb6baad431543b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c3b46d08c4bf5a149abc8fe589909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:41:24.493516 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5080708c-ec87-4c28-b600-e6d427a7f9db tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 200 len: 1332 microversion: 2.1 time: 0.102112 Sep 19 17:41:24.494143 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 613/1235] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:41:24 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:41:25.518576 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:25.519275 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:25.525325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:25.525806 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:25.526241 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:25.526934 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:25.527387 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:25.527843 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:25.540807 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 HTTP/1.1 Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:41:25.542379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:25.544178 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': 'f52bff58-e6e4-4669-8acf-02750b2072d2'} Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:25.545223 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:25.546709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:25.548945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:25.548945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-65c0d3d8-b3c9-4b2e-b697-3f122b7b30d8 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 404 len: 111 microversion: 2.1 time: 0.029862 Sep 19 17:41:25.548945 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 623/1236] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:41:25 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:25.553655 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89976a8c-8b00-451a-8b9b-3d05620d15fb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '.version_select at 0x7fd4d5cca4c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:25.674265 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89976a8c-8b00-451a-8b9b-3d05620d15fb tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516910933" status: 202 len: 0 microversion: 2.1 time: 0.124265 Sep 19 17:41:25.674782 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 614/1237] 10.222.0.61 () {58 vars in 1221 bytes} [Mon Sep 19 17:41:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516910933 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:41:27.675489 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:27.676040 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:27.682613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:27.683098 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:27.683542 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:27.684278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:27.684744 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:27.685175 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:27.698427 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 HTTP/1.1 Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:41:27.699994 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:27.701733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': 'f52bff58-e6e4-4669-8acf-02750b2072d2'} Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:27.702698 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:27.704857 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:27.706686 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:27.706686 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bc9b326e-acae-469b-8277-6d0ae8ca932d tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 404 len: 111 microversion: 2.1 time: 0.029824 Sep 19 17:41:27.706686 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 624/1238] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:41:27 2022] DELETE /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:27.711054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:27.711666 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: f52bff58-e6e4-4669-8acf-02750b2072d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:27.718198 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:27.718676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:27.719718 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:27.720415 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:27.720878 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:27.721301 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:27.734410 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 HTTP/1.1 Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:41:27.736093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:27.737820 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': 'f52bff58-e6e4-4669-8acf-02750b2072d2'} Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:27.738834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. Sep 19 17:41:27.740484 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:27.741962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance f52bff58-e6e4-4669-8acf-02750b2072d2 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:27.741962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf68d771-97ca-4e16-a07a-2f31e2e1b6fa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2" status: 404 len: 111 microversion: 2.1 time: 0.030794 Sep 19 17:41:27.741962 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 615/1239] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:41:27 2022] GET /compute/v2.1/servers/f52bff58-e6e4-4669-8acf-02750b2072d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:29.040076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:29.040584 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:29.047028 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:29.047503 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:29.047976 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:29.048664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:29.049111 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:29.049533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:29.062768 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 HTTP/1.1 Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:41:29.064325 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:41:29.066089 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': 'c5770044-beb3-4748-b53c-c2487feab9f8'} Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:29.067101 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:41:29.070879 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.072511 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:29.072511 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7202afa3-6fa5-4b5d-8a4b-02aa8592d3a0 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 404 len: 111 microversion: 2.1 time: 0.029426 Sep 19 17:41:29.072511 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 625/1240] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:41:29 2022] DELETE /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:29.077065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:29.077676 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: c5770044-beb3-4748-b53c-c2487feab9f8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:29.084636 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:29.085111 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:29.085546 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:29.086231 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:29.086687 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:29.087108 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:29.101247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 HTTP/1.1 Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:41:29.102761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:41:29.104538 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': 'c5770044-beb3-4748-b53c-c2487feab9f8'} Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:29.105680 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. Sep 19 17:41:29.107233 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.108948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance c5770044-beb3-4748-b53c-c2487feab9f8 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:29.108948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a85b944b-2b4c-4865-8ec8-3b5d121e0a5f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8" status: 404 len: 111 microversion: 2.1 time: 0.030995 Sep 19 17:41:29.108948 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 616/1241] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:41:29 2022] GET /compute/v2.1/servers/c5770044-beb3-4748-b53c-c2487feab9f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:29.112602 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:29.113107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:29.119234 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:29.119745 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:29.120192 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:29.120888 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:29.121413 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:29.121847 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:29.135758 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc HTTP/1.1 Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:41:29.137372 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:41:29.139077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '35b92d3a-39ec-402d-a1e8-4f928fca00cc'} Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:29.140112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:41:29.142160 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.143751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:29.143751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6a047b7c-7f8c-49bd-8c71-802c629dfaaa tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 404 len: 111 microversion: 2.1 time: 0.030009 Sep 19 17:41:29.143751 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 626/1242] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:41:29 2022] DELETE /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:29.147900 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:29.148519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 35b92d3a-39ec-402d-a1e8-4f928fca00cc] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:29.154519 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:29.155000 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:29.155445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:29.156173 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:29.157215 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:29.157645 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:29.170874 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc HTTP/1.1 Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:41:29.172565 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:41:29.174262 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '35b92d3a-39ec-402d-a1e8-4f928fca00cc'} Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:29.175221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. Sep 19 17:41:29.176788 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:29.178144 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance 35b92d3a-39ec-402d-a1e8-4f928fca00cc could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:29.178144 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-20f7df80-a19b-4686-8d08-7c8e43b4214f tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc" status: 404 len: 111 microversion: 2.1 time: 0.029950 Sep 19 17:41:29.178144 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 617/1243] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:41:29 2022] GET /compute/v2.1/servers/35b92d3a-39ec-402d-a1e8-4f928fca00cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:30.463539 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:30.464074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:30.471027 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:30.471489 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:30.471957 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:30.472658 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:30.473114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:30.473540 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:30.486614 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 HTTP/1.1 Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:41:30.488107 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:41:30.489765 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '3a67add5-c558-4f0e-ad79-5b1683cfbee3'} Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:30.490928 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:41:30.492746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:30.494396 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:30.494396 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f590cb80-452a-415c-9320-280c559d6792 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 404 len: 111 microversion: 2.1 time: 0.029749 Sep 19 17:41:30.494396 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 627/1244] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:41:30 2022] DELETE /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:30.497747 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:30.498363 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] [instance: 3a67add5-c558-4f0e-ad79-5b1683cfbee3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:41:30.505153 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:30.505630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:30.506064 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:30.506757 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:41:30.507208 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:41:30.507630 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:41:30.521482 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] HTTP exception thrown: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Request method failure captured: Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 HTTP/1.1 Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKemyZ_qLZySQdVJbgcP2SKWqm4a9AsmVgWYOz64WHnV8hwLn2_8QzL0HtoNO6flVqhWBNzM0A9cu1AeRhShVsEc0Owg6wsv_yN82R0qSweXs-W3trt6dTLJr9JT7pzBThFhjl0iyg9trbfH4isnvq0yjIzNYy6RCo3pGiNQaRlartw Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:41:30.523009 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f2c3b46d08c4bf5a149abc8fe589909"}]}] Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 8f2c3b46d08c4bf5a149abc8fe589909 Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1797489461 Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: a8e4233c03174fa18deb6baad431543b Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-1797489461-project Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:41:30.524737 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '3a67add5-c558-4f0e-ad79-5b1683cfbee3'} Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:30.526430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. Sep 19 17:41:30.528141 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:30.529637 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] Returning 404 to user: Instance 3a67add5-c558-4f0e-ad79-5b1683cfbee3 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:30.529637 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-275ab5dd-553c-4044-96bf-bde8260da219 tempest-AttachVolumeNegativeTest-1797489461 tempest-AttachVolumeNegativeTest-1797489461-project] 10.222.0.61 "GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3" status: 404 len: 111 microversion: 2.1 time: 0.030488 Sep 19 17:41:30.529637 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 618/1245] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:41:30 2022] GET /compute/v2.1/servers/3a67add5-c558-4f0e-ad79-5b1683cfbee3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:35.922547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25d024f4-cb5f-4b5e-833a-5e71a01af252 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Action: 'create', calling method: .version_select at 0x7fd4d639e280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-784310395"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:41:36.568071 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25d024f4-cb5f-4b5e-833a-5e71a01af252 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.789948 Sep 19 17:41:36.568791 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 628/1246] 10.222.0.61 () {60 vars in 1155 bytes} [Mon Sep 19 17:41:35 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 791 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 19 17:41:36.582587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad0904fc-54bf-43be-a37f-8fe6d8ed9e5f tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d5f9f040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:36.630052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad0904fc-54bf-43be-a37f-8fe6d8ed9e5f tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26" status: 200 len: 344 microversion: 2.1 time: 0.051321 Sep 19 17:41:36.630613 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 619/1247] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:41:36 2022] GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:37.645155 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-35ab1fa8-714a-49ad-94f4-edee4f95ba37 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d5dc2280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:37.694039 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-35ab1fa8-714a-49ad-94f4-edee4f95ba37 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26" status: 200 len: 345 microversion: 2.1 time: 0.053107 Sep 19 17:41:37.695979 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 629/1248] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:41:37 2022] GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:37.708596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-60e0c165-dae8-42b2-8fcc-6d8910196f06 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Action: 'create', calling method: .version_select at 0x7fd4d6111820>, body: {"snapshot": {"volume_id": "8c389673-0945-4bcf-b5dc-5b9e7659ae26", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1515628304"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:41:38.113701 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-60e0c165-dae8-42b2-8fcc-6d8910196f06 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.409297 Sep 19 17:41:38.114285 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 620/1249] 10.222.0.61 () {60 vars in 1162 bytes} [Mon Sep 19 17:41:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:41:38.125588 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9fb93efc-fb14-4b3a-a347-d7aacbdda614 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d5e64dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:38.156585 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9fb93efc-fb14-4b3a-a347-d7aacbdda614 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3" status: 200 len: 287 microversion: 2.1 time: 0.034184 Sep 19 17:41:38.157163 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 630/1250] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Sep 19 17:41:38 2022] GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:38.168030 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e426a317-d2a0-41ca-a25e-b118d364d1ff tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d5f59dc0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:38.198483 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e426a317-d2a0-41ca-a25e-b118d364d1ff tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034201 Sep 19 17:41:38.199059 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 621/1251] 10.222.0.61 () {58 vars in 1140 bytes} [Mon Sep 19 17:41:38 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:38.211044 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5753d616-8227-4a25-b605-20350fc3596f tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d5de4790>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:38.241189 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5753d616-8227-4a25-b605-20350fc3596f tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3" status: 200 len: 287 microversion: 2.1 time: 0.033951 Sep 19 17:41:38.241788 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 631/1252] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Sep 19 17:41:38 2022] GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:39.254859 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9cbf8d60-3a8e-435b-ad76-ba8a12ff1ebe tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d6173af0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:39.284243 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9cbf8d60-3a8e-435b-ad76-ba8a12ff1ebe tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3" status: 200 len: 287 microversion: 2.1 time: 0.033924 Sep 19 17:41:39.284812 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 622/1253] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Sep 19 17:41:39 2022] GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:41:40.297037 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-78f49a06-7227-4b22-97e4-b8c4a7de91e8 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d9877ca0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:40.327119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-78f49a06-7227-4b22-97e4-b8c4a7de91e8 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3" status: 200 len: 287 microversion: 2.1 time: 0.034550 Sep 19 17:41:40.328229 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 632/1254] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Sep 19 17:41:40 2022] GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:41.338115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:41:41.338897 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:41:41.345413 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-de187368-73cb-4348-9e3e-6581b050bbd5 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d6173ca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:41.378643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-de187368-73cb-4348-9e3e-6581b050bbd5 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3" status: 200 len: 287 microversion: 2.1 time: 0.038633 Sep 19 17:41:41.378643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 623/1255] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Sep 19 17:41:41 2022] GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:42.387535 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:41:42.388366 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:41:42.393931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fee6c199-a604-4df9-aa35-eb919b770eb4 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d9877ca0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:42.425079 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fee6c199-a604-4df9-aa35-eb919b770eb4 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3" status: 200 len: 287 microversion: 2.1 time: 0.037904 Sep 19 17:41:42.425668 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 633/1256] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Sep 19 17:41:42 2022] GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:41:43.438601 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4b699230-fee0-4b4f-aef4-5b9b20f76450 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d5f11b80>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:43.468649 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4b699230-fee0-4b4f-aef4-5b9b20f76450 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3" status: 200 len: 288 microversion: 2.1 time: 0.034950 Sep 19 17:41:43.470047 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 624/1257] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Sep 19 17:41:43 2022] GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:43.482564 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b50ad409-db4e-446b-9e75-23db27402634 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d6e711f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:43.623662 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b50ad409-db4e-446b-9e75-23db27402634 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3" status: 202 len: 0 microversion: 2.1 time: 0.145930 Sep 19 17:41:43.624327 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 634/1258] 10.222.0.61 () {58 vars in 1254 bytes} [Mon Sep 19 17:41:43 2022] DELETE /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:41:43.638053 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c856442-2f6f-4033-8a22-1eec4c412218 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d5f04b80>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:43.668872 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c856442-2f6f-4033-8a22-1eec4c412218 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3" status: 200 len: 287 microversion: 2.1 time: 0.035521 Sep 19 17:41:43.669446 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 625/1259] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Sep 19 17:41:43 2022] GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:41:44.682615 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b3b2827-6a08-4fc1-be51-252989c914c4 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d5dc2310>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:44.708068 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-6b3b2827-6a08-4fc1-be51-252989c914c4 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] HTTP exception thrown: Snapshot 51ecb136-62a5-4fc6-b06a-d8d39abdbde3 could not be found. Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b3b2827-6a08-4fc1-be51-252989c914c4 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Request method failure captured: Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3 HTTP/1.1 Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKnPbjIZSLrUbkQzCU4bGIvmAWQRpxfUwz9CcTQxKf4VwA8nccR7bznpYzF_5ZRqQfwGnEpnPlag9rZatQvjQ2r1eV6C0B-BKc7gNwtVKfw0p5hPun_xdXH8JGYYToG0nJQf-jpJ3g03juQYh2w7xgu6LyMPZ1wY_JwawoxZZFawToM Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 90f2e6fa24194fdfa746e8dfdc024002 Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:41:44.710277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/90f2e6fa24194fdfa746e8dfdc024002"}]}] Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 90f2e6fa24194fdfa746e8dfdc024002 Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-VolumesSnapshotsTestJSON-1718608316-project Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 4b122fb3fed94042bc3fcca9f8b9536e Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1718608316-project Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Snapshot 51ecb136-62a5-4fc6-b06a-d8d39abdbde3 could not be found. Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '51ecb136-62a5-4fc6-b06a-d8d39abdbde3'} Sep 19 17:41:44.712069 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 51ecb136-62a5-4fc6-b06a-d8d39abdbde3 could not be found. (HTTP 404) (Request-ID: req-6e441d44-39f3-44d9-b126-f0184a63907f) Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:44.713076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 17:41:44.714627 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 51ecb136-62a5-4fc6-b06a-d8d39abdbde3 could not be found. Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 19 17:41:44.716504 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 51ecb136-62a5-4fc6-b06a-d8d39abdbde3 could not be found. Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 51ecb136-62a5-4fc6-b06a-d8d39abdbde3 could not be found. Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b3b2827-6a08-4fc1-be51-252989c914c4 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Returning 404 to user: Snapshot 51ecb136-62a5-4fc6-b06a-d8d39abdbde3 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:44.718159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b3b2827-6a08-4fc1-be51-252989c914c4 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3" status: 404 len: 111 microversion: 2.1 time: 0.033673 Sep 19 17:41:44.719881 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 635/1260] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Sep 19 17:41:44 2022] GET /compute/v2.1/os-snapshots/51ecb136-62a5-4fc6-b06a-d8d39abdbde3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:44.722463 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-380432cc-d0af-4dd4-8d95-cca6bc26e225 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d613aee0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:44.879859 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-380432cc-d0af-4dd4-8d95-cca6bc26e225 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26" status: 202 len: 0 microversion: 2.1 time: 0.163117 Sep 19 17:41:44.880439 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 626/1261] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Sep 19 17:41:44 2022] DELETE /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:41:44.892197 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42e47b9d-a23f-47ae-af3a-190d6f5c275a tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d643d4c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:44.944715 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42e47b9d-a23f-47ae-af3a-190d6f5c275a tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26" status: 200 len: 344 microversion: 2.1 time: 0.059535 Sep 19 17:41:44.945286 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 636/1262] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:41:44 2022] GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:45.960010 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65bde75a-020c-4650-b72a-870e6653dd17 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d5f118b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:45.989126 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-65bde75a-020c-4650-b72a-870e6653dd17 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] HTTP exception thrown: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65bde75a-020c-4650-b72a-870e6653dd17 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Request method failure captured: Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26 HTTP/1.1 Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKnPbjIZSLrUbkQzCU4bGIvmAWQRpxfUwz9CcTQxKf4VwA8nccR7bznpYzF_5ZRqQfwGnEpnPlag9rZatQvjQ2r1eV6C0B-BKc7gNwtVKfw0p5hPun_xdXH8JGYYToG0nJQf-jpJ3g03juQYh2w7xgu6LyMPZ1wY_JwawoxZZFawToM Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 90f2e6fa24194fdfa746e8dfdc024002 Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:41:45.991186 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/90f2e6fa24194fdfa746e8dfdc024002"}]}] Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 90f2e6fa24194fdfa746e8dfdc024002 Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-VolumesSnapshotsTestJSON-1718608316-project Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 4b122fb3fed94042bc3fcca9f8b9536e Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1718608316-project Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '8c389673-0945-4bcf-b5dc-5b9e7659ae26'} Sep 19 17:41:45.993052 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. (HTTP 404) (Request-ID: req-662d4234-f95d-4675-8dac-cf5b372b0de9) Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:45.994021 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 17:41:45.995292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 17:41:45.996867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65bde75a-020c-4650-b72a-870e6653dd17 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Returning 404 to user: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-65bde75a-020c-4650-b72a-870e6653dd17 tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26" status: 404 len: 109 microversion: 2.1 time: 0.037028 Sep 19 17:41:45.998137 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 627/1263] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:41:45 2022] GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:46.005014 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c54a3234-a7a2-4e76-b523-c36808e8e98a tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d985e550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:46.033379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c54a3234-a7a2-4e76-b523-c36808e8e98a tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] HTTP exception thrown: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c54a3234-a7a2-4e76-b523-c36808e8e98a tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Request method failure captured: Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: DELETE /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26 HTTP/1.1 Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKnPbjIZSLrUbkQzCU4bGIvmAWQRpxfUwz9CcTQxKf4VwA8nccR7bznpYzF_5ZRqQfwGnEpnPlag9rZatQvjQ2r1eV6C0B-BKc7gNwtVKfw0p5hPun_xdXH8JGYYToG0nJQf-jpJ3g03juQYh2w7xgu6LyMPZ1wY_JwawoxZZFawToM Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 90f2e6fa24194fdfa746e8dfdc024002 Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:41:46.035310 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/90f2e6fa24194fdfa746e8dfdc024002"}]}] Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 90f2e6fa24194fdfa746e8dfdc024002 Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-VolumesSnapshotsTestJSON-1718608316-project Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: 4b122fb3fed94042bc3fcca9f8b9536e Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1718608316-project Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '8c389673-0945-4bcf-b5dc-5b9e7659ae26'} Sep 19 17:41:46.037134 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. (HTTP 404) (Request-ID: req-cd26fc3a-51bb-4378-807a-9df16623e4d0) Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:46.038232 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 17:41:46.039824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 17:41:46.041301 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c54a3234-a7a2-4e76-b523-c36808e8e98a tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Returning 404 to user: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:46.042858 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c54a3234-a7a2-4e76-b523-c36808e8e98a tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26" status: 404 len: 109 microversion: 2.1 time: 0.036312 Sep 19 17:41:46.043924 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 637/1264] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Sep 19 17:41:45 2022] DELETE /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:41:46.045335 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a1222c0-6f0b-4cf7-abef-8bc6b9eeaded tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Calling method '.version_select at 0x7fd4d647ec10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:46.073224 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-9a1222c0-6f0b-4cf7-abef-8bc6b9eeaded tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] HTTP exception thrown: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a1222c0-6f0b-4cf7-abef-8bc6b9eeaded tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Request method failure captured: Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26 HTTP/1.1 Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKnPbjIZSLrUbkQzCU4bGIvmAWQRpxfUwz9CcTQxKf4VwA8nccR7bznpYzF_5ZRqQfwGnEpnPlag9rZatQvjQ2r1eV6C0B-BKc7gNwtVKfw0p5hPun_xdXH8JGYYToG0nJQf-jpJ3g03juQYh2w7xgu6LyMPZ1wY_JwawoxZZFawToM Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 90f2e6fa24194fdfa746e8dfdc024002 Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:41:46.075313 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/90f2e6fa24194fdfa746e8dfdc024002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/90f2e6fa24194fdfa746e8dfdc024002"}]}] Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 90f2e6fa24194fdfa746e8dfdc024002 Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1718608316 Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-VolumesSnapshotsTestJSON-1718608316-project Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 4b122fb3fed94042bc3fcca9f8b9536e Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1718608316-project Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '8c389673-0945-4bcf-b5dc-5b9e7659ae26'} Sep 19 17:41:46.077091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. (HTTP 404) (Request-ID: req-4530a023-d447-4c9a-9164-453eeb853c82) Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:46.078115 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 17:41:46.079596 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 17:41:46.081247 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a1222c0-6f0b-4cf7-abef-8bc6b9eeaded tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] Returning 404 to user: Volume 8c389673-0945-4bcf-b5dc-5b9e7659ae26 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9a1222c0-6f0b-4cf7-abef-8bc6b9eeaded tempest-VolumesSnapshotsTestJSON-1718608316 tempest-VolumesSnapshotsTestJSON-1718608316-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26" status: 404 len: 109 microversion: 2.1 time: 0.035234 Sep 19 17:41:46.082759 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 628/1265] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:41:46 2022] GET /compute/v2.1/os-volumes/8c389673-0945-4bcf-b5dc-5b9e7659ae26 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 17:41:48.120788 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d9f6418-d721-4518-8c32-1ac4c18e7d6b tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] Action: 'create', calling method: .version_select at 0x7fd4d9877d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-129907762", "metadata": {"Type": "work"}}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:41:48.772804 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d9f6418-d721-4518-8c32-1ac4c18e7d6b tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.774240 Sep 19 17:41:48.773430 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 638/1266] 10.222.0.61 () {60 vars in 1156 bytes} [Mon Sep 19 17:41:47 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 776 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 19 17:41:48.787164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bfe1e337-541e-417b-9988-ebf362d3b937 tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] Calling method '.version_select at 0x7fd4d60c38b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:48.836775 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bfe1e337-541e-417b-9988-ebf362d3b937 tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47" status: 200 len: 352 microversion: 2.1 time: 0.053863 Sep 19 17:41:48.839408 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 629/1267] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:41:48 2022] GET /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:49.852371 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-086dd665-a48d-4f14-a003-1449b43c7607 tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] Calling method '.version_select at 0x7fd4d5dc28b0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:49.901470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-086dd665-a48d-4f14-a003-1449b43c7607 tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47" status: 200 len: 353 microversion: 2.1 time: 0.053428 Sep 19 17:41:49.902072 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 639/1268] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:41:49 2022] GET /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:49.916284 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-77923fdb-5df0-4da8-95d6-a3915365c0cc tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] Calling method '.version_select at 0x7fd4d5de2ca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:49.963309 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-77923fdb-5df0-4da8-95d6-a3915365c0cc tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47" status: 200 len: 353 microversion: 2.1 time: 0.051368 Sep 19 17:41:49.963994 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 630/1269] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:41:49 2022] GET /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:49.982895 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6ec93e65-00b0-46c9-982d-b6a3768daa2b tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] Calling method '.version_select at 0x7fd4d5dce670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:50.193777 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ec93e65-00b0-46c9-982d-b6a3768daa2b tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47" status: 202 len: 0 microversion: 2.1 time: 0.214716 Sep 19 17:41:50.198234 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 640/1270] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Sep 19 17:41:49 2022] DELETE /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 17:41:50.202904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e6b43de2-7b4c-468f-8e7d-5032d512411c tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] Calling method '.version_select at 0x7fd4d6062ca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:50.252781 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e6b43de2-7b4c-468f-8e7d-5032d512411c tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47" status: 200 len: 352 microversion: 2.1 time: 0.054205 Sep 19 17:41:50.256611 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 631/1271] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:41:50 2022] GET /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:41:51.268038 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0cc9988-ba00-46a9-9d57-385467cf4d88 tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] Calling method '.version_select at 0x7fd4d5df2430>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:41:51.296383 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b0cc9988-ba00-46a9-9d57-385467cf4d88 tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] HTTP exception thrown: Volume 24d705b2-a7c1-4b39-9413-444e7873bd47 could not be found. Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0cc9988-ba00-46a9-9d57-385467cf4d88 tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] Request method failure captured: Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47 HTTP/1.1 Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKnb0Ha9r35SjJgemg0rCqrggve9axXHfHZY-5pEEQbISeCWpgnyK5usi-6tgfw_ZmIW8RhGtVLkX7XNOhEALWxf8FD_gt9JmElXHv-zIOOVKHm-T2dUSR6s_8OD8BZidToZP9G20-3ayxtwjBPFLWLDfg-ZuOoTNyuDVqXSwQ8xnmo Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: c52c652f55a74c0e9c1535439767afc7 Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesGetTestJSON-813857154 Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:41:51.298346 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c52c652f55a74c0e9c1535439767afc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c52c652f55a74c0e9c1535439767afc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c52c652f55a74c0e9c1535439767afc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c52c652f55a74c0e9c1535439767afc7"}]}] Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-VolumesGetTestJSON-813857154 Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: c52c652f55a74c0e9c1535439767afc7 Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesGetTestJSON-813857154 Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-VolumesGetTestJSON-813857154-project Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: d390887b7a40436ca5578b75f9ccc475 Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-VolumesGetTestJSON-813857154-project Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Volume 24d705b2-a7c1-4b39-9413-444e7873bd47 could not be found. Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '24d705b2-a7c1-4b39-9413-444e7873bd47'} Sep 19 17:41:51.301775 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 24d705b2-a7c1-4b39-9413-444e7873bd47 could not be found. (HTTP 404) (Request-ID: req-a01a21be-24da-457d-a181-6f870ba14257) Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:51.303735 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 17:41:51.306231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 24d705b2-a7c1-4b39-9413-444e7873bd47 could not be found. Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 17:41:51.309029 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 24d705b2-a7c1-4b39-9413-444e7873bd47 could not be found. Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 24d705b2-a7c1-4b39-9413-444e7873bd47 could not be found. Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0cc9988-ba00-46a9-9d57-385467cf4d88 tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] Returning 404 to user: Volume 24d705b2-a7c1-4b39-9413-444e7873bd47 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b0cc9988-ba00-46a9-9d57-385467cf4d88 tempest-VolumesGetTestJSON-813857154 tempest-VolumesGetTestJSON-813857154-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47" status: 404 len: 109 microversion: 2.1 time: 0.036290 Sep 19 17:41:51.311195 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 641/1272] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Sep 19 17:41:51 2022] GET /compute/v2.1/os-volumes/24d705b2-a7c1-4b39-9413-444e7873bd47 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:42:28.002302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-516659210", "imageRef": "c9a26717-946b-4e8c-9af7-971e378e5e3e", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:42:28.058104 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:42:28.333495 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:42:28.333913 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:42:28.334385 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:42:28.334795 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:42:28.335197 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:42:28.345273 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:28.345751 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:28.346192 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:28.346902 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:28.347353 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:28.347815 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:28.365808 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Getting quotas for project 7ab3649e79e344958f3991251622465a. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:42:28.369925 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.quota [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Getting quotas for user 940729a6dcd4426591c196bb46383f50 and project 7ab3649e79e344958f3991251622465a. Resources: {'ram', 'cores', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:42:28.381940 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:42:28.384294 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9a26717-946b-4e8c-9af7-971e378e5e3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:42:28.503316 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bebb3d0a-3bca-4878-a3ec-4817927d20df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506240 Sep 19 17:42:28.504505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 632/1273] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:42:28.516760 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-edfc89b9-4c30-4461-a2e3-daff01bf895b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:28.517389 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-edfc89b9-4c30-4461-a2e3-daff01bf895b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:28.586015 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-edfc89b9-4c30-4461-a2e3-daff01bf895b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:28.594125 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-edfc89b9-4c30-4461-a2e3-daff01bf895b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1214 microversion: 2.1 time: 0.082252 Sep 19 17:42:28.594688 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 642/1274] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:28 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:29.619826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-39c230c3-2c77-4542-b208-0b46e7abb77f tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:29.620640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-39c230c3-2c77-4542-b208-0b46e7abb77f tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:29.628281 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39c230c3-2c77-4542-b208-0b46e7abb77f tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:29.628773 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39c230c3-2c77-4542-b208-0b46e7abb77f tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:29.629221 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39c230c3-2c77-4542-b208-0b46e7abb77f tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:29.630409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39c230c3-2c77-4542-b208-0b46e7abb77f tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:29.630409 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39c230c3-2c77-4542-b208-0b46e7abb77f tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:29.630832 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39c230c3-2c77-4542-b208-0b46e7abb77f tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:29.697304 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-39c230c3-2c77-4542-b208-0b46e7abb77f tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:29.706020 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-39c230c3-2c77-4542-b208-0b46e7abb77f tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1218 microversion: 2.1 time: 0.091284 Sep 19 17:42:29.706598 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 633/1275] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:29 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:30.729074 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-81269f7f-84fe-42ab-b444-cbd02dfc24c5 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:30.729690 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-81269f7f-84fe-42ab-b444-cbd02dfc24c5 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:30.736287 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81269f7f-84fe-42ab-b444-cbd02dfc24c5 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:30.736780 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81269f7f-84fe-42ab-b444-cbd02dfc24c5 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:30.737227 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81269f7f-84fe-42ab-b444-cbd02dfc24c5 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:30.737931 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81269f7f-84fe-42ab-b444-cbd02dfc24c5 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:30.738401 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81269f7f-84fe-42ab-b444-cbd02dfc24c5 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:30.738839 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81269f7f-84fe-42ab-b444-cbd02dfc24c5 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:30.801339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-81269f7f-84fe-42ab-b444-cbd02dfc24c5 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:30.809728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-81269f7f-84fe-42ab-b444-cbd02dfc24c5 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1266 microversion: 2.1 time: 0.084025 Sep 19 17:42:30.810367 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 643/1276] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:30 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:31.832902 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b04b2bf2-f977-40d1-b79d-5123f1cfe48b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:31.833524 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b04b2bf2-f977-40d1-b79d-5123f1cfe48b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:31.840741 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04b2bf2-f977-40d1-b79d-5123f1cfe48b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:31.843918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04b2bf2-f977-40d1-b79d-5123f1cfe48b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:31.843918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04b2bf2-f977-40d1-b79d-5123f1cfe48b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:31.843918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04b2bf2-f977-40d1-b79d-5123f1cfe48b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:31.843918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04b2bf2-f977-40d1-b79d-5123f1cfe48b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:31.844669 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04b2bf2-f977-40d1-b79d-5123f1cfe48b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:31.921562 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b04b2bf2-f977-40d1-b79d-5123f1cfe48b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:31.931292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b04b2bf2-f977-40d1-b79d-5123f1cfe48b tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1272 microversion: 2.1 time: 0.102141 Sep 19 17:42:31.931890 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 634/1277] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:31 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:32.955092 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bddd114c-50cb-44fc-a34e-75be1e6d8085 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:32.955947 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bddd114c-50cb-44fc-a34e-75be1e6d8085 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:32.962748 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bddd114c-50cb-44fc-a34e-75be1e6d8085 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:32.963258 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bddd114c-50cb-44fc-a34e-75be1e6d8085 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:32.963682 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bddd114c-50cb-44fc-a34e-75be1e6d8085 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:32.964484 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bddd114c-50cb-44fc-a34e-75be1e6d8085 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:32.964940 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bddd114c-50cb-44fc-a34e-75be1e6d8085 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:32.965974 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bddd114c-50cb-44fc-a34e-75be1e6d8085 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:32.986444 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 17:42:32.986635 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Mon Sep 19 17:42:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 (ip 10.222.0.61) !!! Sep 19 17:42:32.989019 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 17:42:32.989159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Mon Sep 19 17:42:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 (ip 10.222.0.61) !!! Sep 19 17:42:33.109883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-bddd114c-50cb-44fc-a34e-75be1e6d8085 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:33.117909 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bddd114c-50cb-44fc-a34e-75be1e6d8085 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1314 microversion: 2.1 time: 0.166691 Sep 19 17:42:33.118585 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 644/1278] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:32 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:42:33.302218 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-969d8454-bdf6-4b28-94df-5264c81bd588 req-c0a36e30-b5fa-40fe-956e-5edab79a3d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4552abdf-7e19-43de-aa97-b461aefa0608", "tag": "03a6c830-e52b-4a7e-8611-dd965e963942"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:42:33.312908 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-969d8454-bdf6-4b28-94df-5264c81bd588 req-c0a36e30-b5fa-40fe-956e-5edab79a3d38 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:33.313389 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-969d8454-bdf6-4b28-94df-5264c81bd588 req-c0a36e30-b5fa-40fe-956e-5edab79a3d38 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:33.313834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-969d8454-bdf6-4b28-94df-5264c81bd588 req-c0a36e30-b5fa-40fe-956e-5edab79a3d38 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:33.327029 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-969d8454-bdf6-4b28-94df-5264c81bd588 req-c0a36e30-b5fa-40fe-956e-5edab79a3d38 service nova] Creating event network-changed:03a6c830-e52b-4a7e-8611-dd965e963942 for instance 4552abdf-7e19-43de-aa97-b461aefa0608 on hv-cinder-84801 Sep 19 17:42:33.332319 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-969d8454-bdf6-4b28-94df-5264c81bd588 req-c0a36e30-b5fa-40fe-956e-5edab79a3d38 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034064 Sep 19 17:42:33.333125 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 635/1279] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:42:34.142678 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74070b05-7d2d-42d6-9d98-b02d704aa69d tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:34.143315 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-74070b05-7d2d-42d6-9d98-b02d704aa69d tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:34.149840 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74070b05-7d2d-42d6-9d98-b02d704aa69d tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:34.150379 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74070b05-7d2d-42d6-9d98-b02d704aa69d tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:34.150773 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74070b05-7d2d-42d6-9d98-b02d704aa69d tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:34.151473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74070b05-7d2d-42d6-9d98-b02d704aa69d tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:34.151978 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74070b05-7d2d-42d6-9d98-b02d704aa69d tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:34.152954 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74070b05-7d2d-42d6-9d98-b02d704aa69d tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:34.282086 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-74070b05-7d2d-42d6-9d98-b02d704aa69d tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:34.290093 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-74070b05-7d2d-42d6-9d98-b02d704aa69d tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1314 microversion: 2.1 time: 0.152154 Sep 19 17:42:34.290679 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 645/1280] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:34 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:35.314501 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-100405fe-55eb-4ea5-bc86-09e1ad97fb25 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:35.315203 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-100405fe-55eb-4ea5-bc86-09e1ad97fb25 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:35.321888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-100405fe-55eb-4ea5-bc86-09e1ad97fb25 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:35.322377 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-100405fe-55eb-4ea5-bc86-09e1ad97fb25 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:35.322823 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-100405fe-55eb-4ea5-bc86-09e1ad97fb25 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:35.323523 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-100405fe-55eb-4ea5-bc86-09e1ad97fb25 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:35.324019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-100405fe-55eb-4ea5-bc86-09e1ad97fb25 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:35.324453 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-100405fe-55eb-4ea5-bc86-09e1ad97fb25 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:35.458694 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-100405fe-55eb-4ea5-bc86-09e1ad97fb25 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:35.466860 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-100405fe-55eb-4ea5-bc86-09e1ad97fb25 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1314 microversion: 2.1 time: 0.157170 Sep 19 17:42:35.467430 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 636/1281] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:35 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:36.490728 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0090dba-27ea-4791-87c3-7ea4176d57f2 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:36.491422 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d0090dba-27ea-4791-87c3-7ea4176d57f2 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:36.497907 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0090dba-27ea-4791-87c3-7ea4176d57f2 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:36.498392 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0090dba-27ea-4791-87c3-7ea4176d57f2 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:36.498835 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0090dba-27ea-4791-87c3-7ea4176d57f2 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:36.499536 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0090dba-27ea-4791-87c3-7ea4176d57f2 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:36.500021 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0090dba-27ea-4791-87c3-7ea4176d57f2 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:36.500710 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0090dba-27ea-4791-87c3-7ea4176d57f2 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:36.628971 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0090dba-27ea-4791-87c3-7ea4176d57f2 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:36.636685 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0090dba-27ea-4791-87c3-7ea4176d57f2 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1314 microversion: 2.1 time: 0.149922 Sep 19 17:42:36.637254 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 646/1282] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:36 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:37.660244 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3867fc9-0fe9-4262-a6c2-b474adfed034 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:37.660819 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3867fc9-0fe9-4262-a6c2-b474adfed034 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:37.667423 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3867fc9-0fe9-4262-a6c2-b474adfed034 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:37.667949 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3867fc9-0fe9-4262-a6c2-b474adfed034 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:37.668394 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3867fc9-0fe9-4262-a6c2-b474adfed034 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:37.669729 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3867fc9-0fe9-4262-a6c2-b474adfed034 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:37.670187 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3867fc9-0fe9-4262-a6c2-b474adfed034 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:37.670618 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3867fc9-0fe9-4262-a6c2-b474adfed034 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:37.800615 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f3867fc9-0fe9-4262-a6c2-b474adfed034 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:37.808505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3867fc9-0fe9-4262-a6c2-b474adfed034 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1314 microversion: 2.1 time: 0.152254 Sep 19 17:42:37.809069 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 637/1283] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:37 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:38.832051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6239b631-d02a-4193-b08b-da9302a78314 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:38.832613 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6239b631-d02a-4193-b08b-da9302a78314 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:38.834923 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:42:38.839747 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6239b631-d02a-4193-b08b-da9302a78314 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:38.840237 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6239b631-d02a-4193-b08b-da9302a78314 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:38.840744 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6239b631-d02a-4193-b08b-da9302a78314 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:38.841447 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6239b631-d02a-4193-b08b-da9302a78314 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:38.841906 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6239b631-d02a-4193-b08b-da9302a78314 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:38.842337 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6239b631-d02a-4193-b08b-da9302a78314 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:38.975883 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-6239b631-d02a-4193-b08b-da9302a78314 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:38.984397 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6239b631-d02a-4193-b08b-da9302a78314 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1314 microversion: 2.1 time: 0.156293 Sep 19 17:42:38.985011 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 647/1284] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:38 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:40.007973 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f5cc8799-2db1-40d4-873b-9732d996084a tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:40.008587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f5cc8799-2db1-40d4-873b-9732d996084a tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:40.010535 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:42:40.011202 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:42:40.016699 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5cc8799-2db1-40d4-873b-9732d996084a tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:40.018254 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5cc8799-2db1-40d4-873b-9732d996084a tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:40.018254 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5cc8799-2db1-40d4-873b-9732d996084a tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:40.018512 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5cc8799-2db1-40d4-873b-9732d996084a tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:40.018739 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5cc8799-2db1-40d4-873b-9732d996084a tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:40.019160 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5cc8799-2db1-40d4-873b-9732d996084a tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:40.193506 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f5cc8799-2db1-40d4-873b-9732d996084a tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:40.202041 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f5cc8799-2db1-40d4-873b-9732d996084a tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1314 microversion: 2.1 time: 0.197840 Sep 19 17:42:40.202535 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 638/1285] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:40 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:40.461219 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e8a82ee1-d0d7-4e36-a20e-0dab33ae5635 req-01a126e0-18a4-4ee6-835f-397dd464f1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4552abdf-7e19-43de-aa97-b461aefa0608", "name": "network-vif-plugged", "status": "completed", "tag": "03a6c830-e52b-4a7e-8611-dd965e963942"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:42:40.472076 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e8a82ee1-d0d7-4e36-a20e-0dab33ae5635 req-01a126e0-18a4-4ee6-835f-397dd464f1fe service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:40.472576 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e8a82ee1-d0d7-4e36-a20e-0dab33ae5635 req-01a126e0-18a4-4ee6-835f-397dd464f1fe service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:40.473093 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e8a82ee1-d0d7-4e36-a20e-0dab33ae5635 req-01a126e0-18a4-4ee6-835f-397dd464f1fe service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:40.484274 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e8a82ee1-d0d7-4e36-a20e-0dab33ae5635 req-01a126e0-18a4-4ee6-835f-397dd464f1fe service nova] Creating event network-vif-plugged:03a6c830-e52b-4a7e-8611-dd965e963942 for instance 4552abdf-7e19-43de-aa97-b461aefa0608 on hv-cinder-84801 Sep 19 17:42:40.489415 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e8a82ee1-d0d7-4e36-a20e-0dab33ae5635 req-01a126e0-18a4-4ee6-835f-397dd464f1fe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031938 Sep 19 17:42:40.490060 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 648/1286] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:42:41.225513 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2c1fd4dc-65c2-4f70-a16e-ab574768a8df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:41.226078 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2c1fd4dc-65c2-4f70-a16e-ab574768a8df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:41.233136 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4dc-65c2-4f70-a16e-ab574768a8df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:41.233622 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4dc-65c2-4f70-a16e-ab574768a8df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:41.234065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4dc-65c2-4f70-a16e-ab574768a8df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:41.234761 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4dc-65c2-4f70-a16e-ab574768a8df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:41.235220 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4dc-65c2-4f70-a16e-ab574768a8df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:41.235649 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4dc-65c2-4f70-a16e-ab574768a8df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:41.365171 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2c1fd4dc-65c2-4f70-a16e-ab574768a8df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:41.373085 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2c1fd4dc-65c2-4f70-a16e-ab574768a8df tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1314 microversion: 2.1 time: 0.151476 Sep 19 17:42:41.373652 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 639/1287] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:41 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:42.397122 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6263640-b1ef-4e0c-8067-194b54736511 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:42.397831 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6263640-b1ef-4e0c-8067-194b54736511 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:42.404071 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6263640-b1ef-4e0c-8067-194b54736511 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:42.408968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6263640-b1ef-4e0c-8067-194b54736511 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:42.408968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6263640-b1ef-4e0c-8067-194b54736511 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:42.408968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6263640-b1ef-4e0c-8067-194b54736511 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:42.408968 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6263640-b1ef-4e0c-8067-194b54736511 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:42.409418 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6263640-b1ef-4e0c-8067-194b54736511 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:42.538105 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6263640-b1ef-4e0c-8067-194b54736511 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:42.546320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6263640-b1ef-4e0c-8067-194b54736511 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1314 microversion: 2.1 time: 0.154001 Sep 19 17:42:42.546893 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 649/1288] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:42 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:43.570061 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-651b19ff-eaa5-48b2-8e3b-e4a5bc33fc52 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:43.570696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-651b19ff-eaa5-48b2-8e3b-e4a5bc33fc52 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:43.577260 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-651b19ff-eaa5-48b2-8e3b-e4a5bc33fc52 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:43.577749 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-651b19ff-eaa5-48b2-8e3b-e4a5bc33fc52 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:43.578191 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-651b19ff-eaa5-48b2-8e3b-e4a5bc33fc52 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:43.578888 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-651b19ff-eaa5-48b2-8e3b-e4a5bc33fc52 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:43.579348 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-651b19ff-eaa5-48b2-8e3b-e4a5bc33fc52 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:43.579801 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-651b19ff-eaa5-48b2-8e3b-e4a5bc33fc52 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:43.713151 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-651b19ff-eaa5-48b2-8e3b-e4a5bc33fc52 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:43.721320 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-651b19ff-eaa5-48b2-8e3b-e4a5bc33fc52 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1463 microversion: 2.1 time: 0.155267 Sep 19 17:42:43.721899 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 640/1289] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:43 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1463 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:43.768357 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d28f27aa-08b1-482d-8f9a-5eca0e2aca87 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:43.769432 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d28f27aa-08b1-482d-8f9a-5eca0e2aca87 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:43.776048 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d28f27aa-08b1-482d-8f9a-5eca0e2aca87 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:43.776533 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d28f27aa-08b1-482d-8f9a-5eca0e2aca87 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:43.776998 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d28f27aa-08b1-482d-8f9a-5eca0e2aca87 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:43.777790 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d28f27aa-08b1-482d-8f9a-5eca0e2aca87 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:43.778144 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d28f27aa-08b1-482d-8f9a-5eca0e2aca87 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:43.778569 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d28f27aa-08b1-482d-8f9a-5eca0e2aca87 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:43.805641 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d28f27aa-08b1-482d-8f9a-5eca0e2aca87 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:42:44.071778 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d28f27aa-08b1-482d-8f9a-5eca0e2aca87 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 204 len: 0 microversion: 2.1 time: 0.306795 Sep 19 17:42:44.072305 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 650/1290] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:42:43 2022] DELETE /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:42:44.081245 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a6dad73-2e16-4d21-92a2-4d16778f0853 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:44.081862 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a6dad73-2e16-4d21-92a2-4d16778f0853 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:44.087938 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a6dad73-2e16-4d21-92a2-4d16778f0853 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:44.088447 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a6dad73-2e16-4d21-92a2-4d16778f0853 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:44.088902 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a6dad73-2e16-4d21-92a2-4d16778f0853 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:44.089832 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a6dad73-2e16-4d21-92a2-4d16778f0853 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:44.090212 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a6dad73-2e16-4d21-92a2-4d16778f0853 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:44.090894 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a6dad73-2e16-4d21-92a2-4d16778f0853 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:44.217669 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a6dad73-2e16-4d21-92a2-4d16778f0853 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:44.226085 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a6dad73-2e16-4d21-92a2-4d16778f0853 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1469 microversion: 2.1 time: 0.148833 Sep 19 17:42:44.226668 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 641/1291] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:44 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:45.249807 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ac946eb2-4532-4ecc-b296-a6831e041969 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:45.250754 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ac946eb2-4532-4ecc-b296-a6831e041969 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:45.257046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac946eb2-4532-4ecc-b296-a6831e041969 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:45.257509 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac946eb2-4532-4ecc-b296-a6831e041969 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:45.257941 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac946eb2-4532-4ecc-b296-a6831e041969 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:45.258622 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac946eb2-4532-4ecc-b296-a6831e041969 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:45.259071 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac946eb2-4532-4ecc-b296-a6831e041969 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:45.259491 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac946eb2-4532-4ecc-b296-a6831e041969 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:45.390378 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-ac946eb2-4532-4ecc-b296-a6831e041969 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:45.399118 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ac946eb2-4532-4ecc-b296-a6831e041969 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1469 microversion: 2.1 time: 0.153331 Sep 19 17:42:45.399949 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 651/1292] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:45 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:46.326230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7ffa43b8-9de3-48a7-800b-e63cdbc3c12c req-a34fea7c-d29d-42bd-b2d2-28598bd97b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4552abdf-7e19-43de-aa97-b461aefa0608", "name": "network-vif-deleted", "tag": "03a6c830-e52b-4a7e-8611-dd965e963942"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:42:46.336646 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7ffa43b8-9de3-48a7-800b-e63cdbc3c12c req-a34fea7c-d29d-42bd-b2d2-28598bd97b61 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:46.337325 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7ffa43b8-9de3-48a7-800b-e63cdbc3c12c req-a34fea7c-d29d-42bd-b2d2-28598bd97b61 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:46.337754 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7ffa43b8-9de3-48a7-800b-e63cdbc3c12c req-a34fea7c-d29d-42bd-b2d2-28598bd97b61 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:46.349640 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7ffa43b8-9de3-48a7-800b-e63cdbc3c12c req-a34fea7c-d29d-42bd-b2d2-28598bd97b61 service nova] Creating event network-vif-deleted:03a6c830-e52b-4a7e-8611-dd965e963942 for instance 4552abdf-7e19-43de-aa97-b461aefa0608 on hv-cinder-84801 Sep 19 17:42:46.355505 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7ffa43b8-9de3-48a7-800b-e63cdbc3c12c req-a34fea7c-d29d-42bd-b2d2-28598bd97b61 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 Sep 19 17:42:46.358837 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 642/1293] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:42:46.424425 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-994d1755-a9c5-4165-9e43-261ee6a71250 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:46.425190 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-994d1755-a9c5-4165-9e43-261ee6a71250 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:46.431653 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994d1755-a9c5-4165-9e43-261ee6a71250 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:46.432150 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994d1755-a9c5-4165-9e43-261ee6a71250 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:46.432589 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994d1755-a9c5-4165-9e43-261ee6a71250 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:46.433443 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994d1755-a9c5-4165-9e43-261ee6a71250 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:46.433902 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994d1755-a9c5-4165-9e43-261ee6a71250 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:46.434329 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994d1755-a9c5-4165-9e43-261ee6a71250 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:46.498216 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-994d1755-a9c5-4165-9e43-261ee6a71250 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '940729a6dcd4426591c196bb46383f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab3649e79e344958f3991251622465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:42:46.506277 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-994d1755-a9c5-4165-9e43-261ee6a71250 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 200 len: 1427 microversion: 2.1 time: 0.085746 Sep 19 17:42:46.506849 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 652/1294] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:46 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:42:47.530897 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:42:47.531631 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] [instance: 4552abdf-7e19-43de-aa97-b461aefa0608] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:42:47.538382 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:47.538868 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:47.539311 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:47.540040 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:42:47.540502 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:42:47.540932 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:42:47.556346 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] HTTP exception thrown: Instance 4552abdf-7e19-43de-aa97-b461aefa0608 could not be found. Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Request method failure captured: Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 HTTP/1.1 Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKoBqNtFpCws6VaPjcV8GCfbEWfpoBrp2FT7aEELpVk6lIkol3Xo4YSuJixPR9LoMDdKPDYMoiE0CdePbFKi3VN8FKyiTZMCCk-hZuzdldP0sM-hGKl34fu293Iyiv5o0q-YDAdOoU1xqkbYTAGW5NYL73LpsdUWS339qKYTJjKnuqI Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 7ab3649e79e344958f3991251622465a Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesNegativeTest-1254500338 Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:42:47.557967 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ab3649e79e344958f3991251622465a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ab3649e79e344958f3991251622465a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ab3649e79e344958f3991251622465a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ab3649e79e344958f3991251622465a"}]}] Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-VolumesNegativeTest-1254500338 Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 7ab3649e79e344958f3991251622465a Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesNegativeTest-1254500338 Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-VolumesNegativeTest-1254500338-project Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: 940729a6dcd4426591c196bb46383f50 Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-VolumesNegativeTest-1254500338-project Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance 4552abdf-7e19-43de-aa97-b461aefa0608 could not be found. Sep 19 17:42:47.559628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': '4552abdf-7e19-43de-aa97-b461aefa0608'} Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4552abdf-7e19-43de-aa97-b461aefa0608 could not be found. Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:42:47.567648 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4552abdf-7e19-43de-aa97-b461aefa0608 could not be found. Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4552abdf-7e19-43de-aa97-b461aefa0608 could not be found. Sep 19 17:42:47.569427 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:42:47.571941 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] Returning 404 to user: Instance 4552abdf-7e19-43de-aa97-b461aefa0608 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:42:47.571941 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0778c7e2-b03c-4451-a2a6-7157c24d0482 tempest-VolumesNegativeTest-1254500338 tempest-VolumesNegativeTest-1254500338-project] 10.222.0.61 "GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608" status: 404 len: 111 microversion: 2.1 time: 0.032748 Sep 19 17:42:47.571941 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 643/1295] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:42:47 2022] GET /compute/v2.1/servers/4552abdf-7e19-43de-aa97-b461aefa0608 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:43:08.205603 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1544978263", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1139086849", "security_groups": [{"name": "tempest-secgroup-smoke-1369752678"}], "block_device_mapping_v2": [{"uuid": "2145f20b-cc6f-4a8f-b470-83d506a2dd39", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1590abdf-b953-4897-85f6-bffe0b292150"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:43:08.216312 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:43:08.216997 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:43:08.323998 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] validate_networks() for [('1590abdf-b953-4897-85f6-bffe0b292150', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 17:43:08.695637 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 17:43:08.696084 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 17:43:08.696555 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 17:43:08.696983 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 17:43:08.697487 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 17:43:08.706854 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:08.707320 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:08.707789 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:08.708507 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:08.708953 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:08.709373 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:08.728922 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Getting quotas for project 3fa7a842679b460f87e34a84e7d12c5f. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 17:43:08.733113 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.quota [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Getting quotas for user a695d9e178414ba294fc30fe12edf7aa and project 3fa7a842679b460f87e34a84e7d12c5f. Resources: {'ram', 'cores', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 17:43:08.789736 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 17:43:08.791866 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2145f20b-cc6f-4a8f-b470-83d506a2dd39',volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 17:43:09.165577 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aa5842c3-d317-4c90-adc1-01e9e1bfef7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.963748 Sep 19 17:43:09.166237 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 653/1296] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Sep 19 17:43:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 17:43:09.177841 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83991044-187d-420f-b122-fae7545c629a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:09.178457 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-83991044-187d-420f-b122-fae7545c629a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:09.180643 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:43:09.181319 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=56 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:43:09.237272 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-83991044-187d-420f-b122-fae7545c629a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:09.244472 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-83991044-187d-420f-b122-fae7545c629a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1095 microversion: 2.1 time: 0.070678 Sep 19 17:43:09.245054 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 644/1297] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:09 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 17:43:10.268317 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2444df4-a5e2-42dd-88f1-6c6185882513 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:10.268875 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2444df4-a5e2-42dd-88f1-6c6185882513 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:10.275011 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2444df4-a5e2-42dd-88f1-6c6185882513 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:10.275886 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2444df4-a5e2-42dd-88f1-6c6185882513 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:10.276056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2444df4-a5e2-42dd-88f1-6c6185882513 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:10.276623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2444df4-a5e2-42dd-88f1-6c6185882513 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:10.277068 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2444df4-a5e2-42dd-88f1-6c6185882513 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:10.277489 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2444df4-a5e2-42dd-88f1-6c6185882513 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:10.340668 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-e2444df4-a5e2-42dd-88f1-6c6185882513 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:10.348525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2444df4-a5e2-42dd-88f1-6c6185882513 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1145 microversion: 2.1 time: 0.084762 Sep 19 17:43:10.349083 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 654/1298] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:10 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:11.373042 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f2844d2-d428-4262-822c-5e8eaed5ffa4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:11.373699 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f2844d2-d428-4262-822c-5e8eaed5ffa4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:11.381347 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f2844d2-d428-4262-822c-5e8eaed5ffa4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:11.381834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f2844d2-d428-4262-822c-5e8eaed5ffa4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:11.382269 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f2844d2-d428-4262-822c-5e8eaed5ffa4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:11.383011 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f2844d2-d428-4262-822c-5e8eaed5ffa4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:11.383468 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f2844d2-d428-4262-822c-5e8eaed5ffa4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:11.383933 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f2844d2-d428-4262-822c-5e8eaed5ffa4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:11.455354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f2844d2-d428-4262-822c-5e8eaed5ffa4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:11.463574 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f2844d2-d428-4262-822c-5e8eaed5ffa4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1211 microversion: 2.1 time: 0.095051 Sep 19 17:43:11.464201 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 645/1299] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:11 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:12.486871 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a0279f3-af54-4a29-9c83-bb5b9e1346eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:12.487543 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a0279f3-af54-4a29-9c83-bb5b9e1346eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:12.493711 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a0279f3-af54-4a29-9c83-bb5b9e1346eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:12.498097 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a0279f3-af54-4a29-9c83-bb5b9e1346eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:12.498097 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a0279f3-af54-4a29-9c83-bb5b9e1346eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:12.498097 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a0279f3-af54-4a29-9c83-bb5b9e1346eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:12.498097 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a0279f3-af54-4a29-9c83-bb5b9e1346eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:12.498547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a0279f3-af54-4a29-9c83-bb5b9e1346eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:12.640844 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1a0279f3-af54-4a29-9c83-bb5b9e1346eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:12.649659 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a0279f3-af54-4a29-9c83-bb5b9e1346eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1279 microversion: 2.1 time: 0.167122 Sep 19 17:43:12.650321 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 655/1300] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:12 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:12.889528 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-1c6b5bd6-b19f-4d1d-9d34-23a3236f4c0f req-91c71cf7-1fa9-4f56-ade8-1225c876e95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d561cde2-43c9-45a8-a190-51ebb242d93d", "tag": "93892384-9312-48a0-b5ef-f79b27e3fcf1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:43:12.902995 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1c6b5bd6-b19f-4d1d-9d34-23a3236f4c0f req-91c71cf7-1fa9-4f56-ade8-1225c876e95b service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:12.903493 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1c6b5bd6-b19f-4d1d-9d34-23a3236f4c0f req-91c71cf7-1fa9-4f56-ade8-1225c876e95b service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:12.903955 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1c6b5bd6-b19f-4d1d-9d34-23a3236f4c0f req-91c71cf7-1fa9-4f56-ade8-1225c876e95b service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:12.915885 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-1c6b5bd6-b19f-4d1d-9d34-23a3236f4c0f req-91c71cf7-1fa9-4f56-ade8-1225c876e95b service nova] Creating event network-changed:93892384-9312-48a0-b5ef-f79b27e3fcf1 for instance d561cde2-43c9-45a8-a190-51ebb242d93d on hv-cinder-84801 Sep 19 17:43:12.921795 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-1c6b5bd6-b19f-4d1d-9d34-23a3236f4c0f req-91c71cf7-1fa9-4f56-ade8-1225c876e95b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036664 Sep 19 17:43:12.922417 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 646/1301] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:43:13.674317 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6f9dd10-70f5-45bb-a442-b0d137efe5a6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:13.674317 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c6f9dd10-70f5-45bb-a442-b0d137efe5a6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:13.679459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f9dd10-70f5-45bb-a442-b0d137efe5a6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:13.680051 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f9dd10-70f5-45bb-a442-b0d137efe5a6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:13.680495 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f9dd10-70f5-45bb-a442-b0d137efe5a6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:13.681198 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f9dd10-70f5-45bb-a442-b0d137efe5a6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:13.681653 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f9dd10-70f5-45bb-a442-b0d137efe5a6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:13.682080 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f9dd10-70f5-45bb-a442-b0d137efe5a6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:13.819473 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-c6f9dd10-70f5-45bb-a442-b0d137efe5a6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:13.828062 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c6f9dd10-70f5-45bb-a442-b0d137efe5a6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.158827 Sep 19 17:43:13.828601 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 656/1302] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:13 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:14.851954 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5d38a92-69fe-4629-922f-f5aa8c52ddf8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:14.852665 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5d38a92-69fe-4629-922f-f5aa8c52ddf8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:14.859236 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5d38a92-69fe-4629-922f-f5aa8c52ddf8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:14.859809 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5d38a92-69fe-4629-922f-f5aa8c52ddf8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:14.860255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5d38a92-69fe-4629-922f-f5aa8c52ddf8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:14.860944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5d38a92-69fe-4629-922f-f5aa8c52ddf8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:14.861404 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5d38a92-69fe-4629-922f-f5aa8c52ddf8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:14.861830 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5d38a92-69fe-4629-922f-f5aa8c52ddf8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:14.992266 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5d38a92-69fe-4629-922f-f5aa8c52ddf8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:14.997870 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5d38a92-69fe-4629-922f-f5aa8c52ddf8 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.150209 Sep 19 17:43:14.998449 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 647/1303] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:14 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:16.021369 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ffe0865-4e09-4542-9f34-0b236a73f9e6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:16.021978 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ffe0865-4e09-4542-9f34-0b236a73f9e6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:16.028489 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ffe0865-4e09-4542-9f34-0b236a73f9e6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:16.029040 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ffe0865-4e09-4542-9f34-0b236a73f9e6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:16.029480 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ffe0865-4e09-4542-9f34-0b236a73f9e6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:16.030701 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ffe0865-4e09-4542-9f34-0b236a73f9e6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:16.031164 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ffe0865-4e09-4542-9f34-0b236a73f9e6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:16.031594 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ffe0865-4e09-4542-9f34-0b236a73f9e6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:16.161137 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ffe0865-4e09-4542-9f34-0b236a73f9e6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:16.169009 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ffe0865-4e09-4542-9f34-0b236a73f9e6 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.151509 Sep 19 17:43:16.169588 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 657/1304] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:16 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:17.192182 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e6d5e6b4-281f-4af5-a749-ab8616b7a3a4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:17.192797 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e6d5e6b4-281f-4af5-a749-ab8616b7a3a4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:17.199408 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6d5e6b4-281f-4af5-a749-ab8616b7a3a4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:17.199923 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6d5e6b4-281f-4af5-a749-ab8616b7a3a4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:17.200424 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6d5e6b4-281f-4af5-a749-ab8616b7a3a4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:17.201168 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6d5e6b4-281f-4af5-a749-ab8616b7a3a4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:17.201626 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6d5e6b4-281f-4af5-a749-ab8616b7a3a4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:17.202065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6d5e6b4-281f-4af5-a749-ab8616b7a3a4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:17.337486 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-e6d5e6b4-281f-4af5-a749-ab8616b7a3a4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:17.345692 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e6d5e6b4-281f-4af5-a749-ab8616b7a3a4 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.157420 Sep 19 17:43:17.346256 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 648/1305] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:17 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:18.372171 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be66f652-b5f9-4973-b040-24719b0b4fb7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:18.372818 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-be66f652-b5f9-4973-b040-24719b0b4fb7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:18.379560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be66f652-b5f9-4973-b040-24719b0b4fb7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:18.380250 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be66f652-b5f9-4973-b040-24719b0b4fb7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:18.380693 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be66f652-b5f9-4973-b040-24719b0b4fb7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:18.381408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be66f652-b5f9-4973-b040-24719b0b4fb7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:18.381906 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be66f652-b5f9-4973-b040-24719b0b4fb7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:18.382339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be66f652-b5f9-4973-b040-24719b0b4fb7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:18.520664 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-be66f652-b5f9-4973-b040-24719b0b4fb7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:18.528599 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-be66f652-b5f9-4973-b040-24719b0b4fb7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.160359 Sep 19 17:43:18.529172 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 658/1306] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:18 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:19.552511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-91c6d526-3510-415b-8d28-1383fca92309 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:19.553065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-91c6d526-3510-415b-8d28-1383fca92309 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:19.555376 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:43:19.560455 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c6d526-3510-415b-8d28-1383fca92309 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:19.560944 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c6d526-3510-415b-8d28-1383fca92309 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:19.561390 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c6d526-3510-415b-8d28-1383fca92309 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:19.562583 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c6d526-3510-415b-8d28-1383fca92309 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:19.563041 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c6d526-3510-415b-8d28-1383fca92309 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:19.563473 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91c6d526-3510-415b-8d28-1383fca92309 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:19.698731 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-91c6d526-3510-415b-8d28-1383fca92309 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:19.707230 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-91c6d526-3510-415b-8d28-1383fca92309 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.158633 Sep 19 17:43:19.707934 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 649/1307] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:19 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:20.730414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ace42f2-5914-49e3-a527-670a5e0a7921 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:20.731103 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ace42f2-5914-49e3-a527-670a5e0a7921 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:20.732876 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:43:20.733622 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:43:20.739058 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ace42f2-5914-49e3-a527-670a5e0a7921 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:20.744188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ace42f2-5914-49e3-a527-670a5e0a7921 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:20.744188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ace42f2-5914-49e3-a527-670a5e0a7921 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:20.744188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ace42f2-5914-49e3-a527-670a5e0a7921 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:20.744188 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ace42f2-5914-49e3-a527-670a5e0a7921 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:20.744660 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ace42f2-5914-49e3-a527-670a5e0a7921 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:20.874709 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ace42f2-5914-49e3-a527-670a5e0a7921 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:20.882483 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ace42f2-5914-49e3-a527-670a5e0a7921 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.156039 Sep 19 17:43:20.883056 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 659/1308] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:20 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:21.905824 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a56ffe23-2066-4bac-9d0a-8c9bede9ad3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:21.906956 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a56ffe23-2066-4bac-9d0a-8c9bede9ad3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:21.913426 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ffe23-2066-4bac-9d0a-8c9bede9ad3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:21.913918 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ffe23-2066-4bac-9d0a-8c9bede9ad3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:21.914364 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ffe23-2066-4bac-9d0a-8c9bede9ad3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:21.915064 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ffe23-2066-4bac-9d0a-8c9bede9ad3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:21.915531 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ffe23-2066-4bac-9d0a-8c9bede9ad3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:21.915987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ffe23-2066-4bac-9d0a-8c9bede9ad3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:22.048475 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-a56ffe23-2066-4bac-9d0a-8c9bede9ad3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:22.056332 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a56ffe23-2066-4bac-9d0a-8c9bede9ad3e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.154530 Sep 19 17:43:22.056906 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 650/1309] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:21 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:23.081595 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8b1ad64d-7128-4553-9886-6925630d4d7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:23.082174 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8b1ad64d-7128-4553-9886-6925630d4d7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:23.088623 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b1ad64d-7128-4553-9886-6925630d4d7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:23.089112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b1ad64d-7128-4553-9886-6925630d4d7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:23.089556 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b1ad64d-7128-4553-9886-6925630d4d7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:23.090257 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b1ad64d-7128-4553-9886-6925630d4d7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:23.090719 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b1ad64d-7128-4553-9886-6925630d4d7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:23.091152 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b1ad64d-7128-4553-9886-6925630d4d7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:23.220374 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-8b1ad64d-7128-4553-9886-6925630d4d7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:23.228470 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8b1ad64d-7128-4553-9886-6925630d4d7b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.152918 Sep 19 17:43:23.229166 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 660/1310] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:23 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:24.252578 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f90a9d1e-cf7b-404c-98b6-ecf1a05ac560 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:24.253185 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f90a9d1e-cf7b-404c-98b6-ecf1a05ac560 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:24.259826 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f90a9d1e-cf7b-404c-98b6-ecf1a05ac560 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:24.260302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f90a9d1e-cf7b-404c-98b6-ecf1a05ac560 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:24.260733 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f90a9d1e-cf7b-404c-98b6-ecf1a05ac560 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:24.261418 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f90a9d1e-cf7b-404c-98b6-ecf1a05ac560 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:24.261895 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f90a9d1e-cf7b-404c-98b6-ecf1a05ac560 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:24.262394 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f90a9d1e-cf7b-404c-98b6-ecf1a05ac560 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:24.393193 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-f90a9d1e-cf7b-404c-98b6-ecf1a05ac560 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:24.401019 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f90a9d1e-cf7b-404c-98b6-ecf1a05ac560 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.153164 Sep 19 17:43:24.401595 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 651/1311] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:24 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:24.737364 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-85f0ce9f-1174-43e5-a38b-a46e87e077cc req-6a1853f6-652c-44f2-a975-0d74ca8a7441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d561cde2-43c9-45a8-a190-51ebb242d93d", "name": "network-vif-plugged", "status": "completed", "tag": "93892384-9312-48a0-b5ef-f79b27e3fcf1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:43:24.747235 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-85f0ce9f-1174-43e5-a38b-a46e87e077cc req-6a1853f6-652c-44f2-a975-0d74ca8a7441 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:24.747760 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-85f0ce9f-1174-43e5-a38b-a46e87e077cc req-6a1853f6-652c-44f2-a975-0d74ca8a7441 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:24.750226 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-85f0ce9f-1174-43e5-a38b-a46e87e077cc req-6a1853f6-652c-44f2-a975-0d74ca8a7441 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:24.759370 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-85f0ce9f-1174-43e5-a38b-a46e87e077cc req-6a1853f6-652c-44f2-a975-0d74ca8a7441 service nova] Creating event network-vif-plugged:93892384-9312-48a0-b5ef-f79b27e3fcf1 for instance d561cde2-43c9-45a8-a190-51ebb242d93d on hv-cinder-84801 Sep 19 17:43:24.764349 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-85f0ce9f-1174-43e5-a38b-a46e87e077cc req-6a1853f6-652c-44f2-a975-0d74ca8a7441 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031286 Sep 19 17:43:24.764995 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 661/1312] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:43:25.423872 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b659d69a-e9ed-4c0d-8a84-3630292f3be7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:25.424493 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b659d69a-e9ed-4c0d-8a84-3630292f3be7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:25.430969 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b659d69a-e9ed-4c0d-8a84-3630292f3be7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:25.431447 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b659d69a-e9ed-4c0d-8a84-3630292f3be7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:25.431929 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b659d69a-e9ed-4c0d-8a84-3630292f3be7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:25.432628 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b659d69a-e9ed-4c0d-8a84-3630292f3be7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:25.433091 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b659d69a-e9ed-4c0d-8a84-3630292f3be7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:25.433526 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b659d69a-e9ed-4c0d-8a84-3630292f3be7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:25.815071 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-b659d69a-e9ed-4c0d-8a84-3630292f3be7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:25.822835 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b659d69a-e9ed-4c0d-8a84-3630292f3be7 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.403100 Sep 19 17:43:25.823408 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 652/1313] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:25 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:26.846506 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d90c5455-ddee-4b7a-a935-d44350981c66 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:26.847219 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d90c5455-ddee-4b7a-a935-d44350981c66 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:26.853594 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d90c5455-ddee-4b7a-a935-d44350981c66 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:26.854083 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d90c5455-ddee-4b7a-a935-d44350981c66 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:26.854525 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d90c5455-ddee-4b7a-a935-d44350981c66 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:26.855222 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d90c5455-ddee-4b7a-a935-d44350981c66 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:26.855679 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d90c5455-ddee-4b7a-a935-d44350981c66 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:26.856130 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d90c5455-ddee-4b7a-a935-d44350981c66 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:26.990281 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-d90c5455-ddee-4b7a-a935-d44350981c66 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:26.998285 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d90c5455-ddee-4b7a-a935-d44350981c66 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1267 microversion: 2.1 time: 0.156458 Sep 19 17:43:26.998863 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 662/1314] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:26 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:28.021570 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62d51bdf-bbcb-4fcb-b7bc-b01418ec5f93 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:28.022194 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62d51bdf-bbcb-4fcb-b7bc-b01418ec5f93 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:28.028917 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62d51bdf-bbcb-4fcb-b7bc-b01418ec5f93 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:28.029412 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62d51bdf-bbcb-4fcb-b7bc-b01418ec5f93 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:28.029857 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62d51bdf-bbcb-4fcb-b7bc-b01418ec5f93 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:28.030587 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62d51bdf-bbcb-4fcb-b7bc-b01418ec5f93 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:28.031568 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62d51bdf-bbcb-4fcb-b7bc-b01418ec5f93 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:28.032005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62d51bdf-bbcb-4fcb-b7bc-b01418ec5f93 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:28.165139 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-62d51bdf-bbcb-4fcb-b7bc-b01418ec5f93 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:28.172901 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62d51bdf-bbcb-4fcb-b7bc-b01418ec5f93 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1454 microversion: 2.1 time: 0.155390 Sep 19 17:43:28.173470 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 653/1315] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:28 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:28.194796 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7cf85a12-65b3-4037-8d15-06c9d9ad587e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:43:28.195408 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7cf85a12-65b3-4037-8d15-06c9d9ad587e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:43:28.201824 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf85a12-65b3-4037-8d15-06c9d9ad587e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:28.202313 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf85a12-65b3-4037-8d15-06c9d9ad587e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:28.203278 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf85a12-65b3-4037-8d15-06c9d9ad587e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:28.204007 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf85a12-65b3-4037-8d15-06c9d9ad587e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:28.204465 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf85a12-65b3-4037-8d15-06c9d9ad587e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:28.204893 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf85a12-65b3-4037-8d15-06c9d9ad587e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:28.334461 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-7cf85a12-65b3-4037-8d15-06c9d9ad587e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:43:28.342154 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7cf85a12-65b3-4037-8d15-06c9d9ad587e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1454 microversion: 2.1 time: 0.151169 Sep 19 17:43:28.342717 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 663/1316] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:43:28 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:43:30.410544 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ed79a7a6-e526-40ae-980e-a28c6f630388 req-43d3f229-52a8-44fe-9333-4837e70a522e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d561cde2-43c9-45a8-a190-51ebb242d93d", "tag": "93892384-9312-48a0-b5ef-f79b27e3fcf1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:43:30.421818 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed79a7a6-e526-40ae-980e-a28c6f630388 req-43d3f229-52a8-44fe-9333-4837e70a522e service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:43:30.422302 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed79a7a6-e526-40ae-980e-a28c6f630388 req-43d3f229-52a8-44fe-9333-4837e70a522e service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:43:30.422733 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed79a7a6-e526-40ae-980e-a28c6f630388 req-43d3f229-52a8-44fe-9333-4837e70a522e service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:43:30.435065 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ed79a7a6-e526-40ae-980e-a28c6f630388 req-43d3f229-52a8-44fe-9333-4837e70a522e service nova] Creating event network-changed:93892384-9312-48a0-b5ef-f79b27e3fcf1 for instance d561cde2-43c9-45a8-a190-51ebb242d93d on hv-cinder-84801 Sep 19 17:43:30.441496 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ed79a7a6-e526-40ae-980e-a28c6f630388 req-43d3f229-52a8-44fe-9333-4837e70a522e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034450 Sep 19 17:43:30.442380 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 654/1317] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:45:19.980463 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c610d08-85d8-46b8-92e6-dbcd57984c58] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 17:45:19.981285 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:45:19.982073 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=58 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:45:19.987530 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d798ab3e-bf27-48b2-852f-ec641a55f0fa tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:19.991241 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=24 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:45:19.992034 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=52 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:45:19.993365 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 17:45:19.993516 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Mon Sep 19 17:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Sep 19 17:45:19.994554 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 17:45:19.994675 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Mon Sep 19 17:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Sep 19 17:45:20.001292 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f3ce344d-2ecf-47fa-bcd3-e0ec7e3bf254 req-371e11fc-000e-4480-9fb9-795e3b013544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d561cde2-43c9-45a8-a190-51ebb242d93d", "tag": "93892384-9312-48a0-b5ef-f79b27e3fcf1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:45:20.008252 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d798ab3e-bf27-48b2-852f-ec641a55f0fa tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:20.015414 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d798ab3e-bf27-48b2-852f-ec641a55f0fa tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:20.016067 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f3ce344d-2ecf-47fa-bcd3-e0ec7e3bf254 req-371e11fc-000e-4480-9fb9-795e3b013544 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:20.016212 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d798ab3e-bf27-48b2-852f-ec641a55f0fa tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:20.016551 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f3ce344d-2ecf-47fa-bcd3-e0ec7e3bf254 req-371e11fc-000e-4480-9fb9-795e3b013544 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:20.016674 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d798ab3e-bf27-48b2-852f-ec641a55f0fa tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:20.016986 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f3ce344d-2ecf-47fa-bcd3-e0ec7e3bf254 req-371e11fc-000e-4480-9fb9-795e3b013544 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:20.017547 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d798ab3e-bf27-48b2-852f-ec641a55f0fa tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:20.018119 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d798ab3e-bf27-48b2-852f-ec641a55f0fa tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:20.019231 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d798ab3e-bf27-48b2-852f-ec641a55f0fa tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:20.029742 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f3ce344d-2ecf-47fa-bcd3-e0ec7e3bf254 req-371e11fc-000e-4480-9fb9-795e3b013544 service nova] Creating event network-changed:93892384-9312-48a0-b5ef-f79b27e3fcf1 for instance d561cde2-43c9-45a8-a190-51ebb242d93d on hv-cinder-84801 Sep 19 17:45:20.035417 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f3ce344d-2ecf-47fa-bcd3-e0ec7e3bf254 req-371e11fc-000e-4480-9fb9-795e3b013544 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046248 Sep 19 17:45:20.036166 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 655/1318] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:45:20.049273 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d798ab3e-bf27-48b2-852f-ec641a55f0fa tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:45:20.370972 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d798ab3e-bf27-48b2-852f-ec641a55f0fa tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 204 len: 0 microversion: 2.1 time: 0.392132 Sep 19 17:45:20.372692 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 664/1319] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:45:19 2022] DELETE /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:45:20.382318 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cb0881f6-31e9-47ae-8179-4b58f09a53eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:20.383315 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cb0881f6-31e9-47ae-8179-4b58f09a53eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:20.390769 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb0881f6-31e9-47ae-8179-4b58f09a53eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:20.392255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb0881f6-31e9-47ae-8179-4b58f09a53eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:20.392255 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb0881f6-31e9-47ae-8179-4b58f09a53eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:20.393006 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb0881f6-31e9-47ae-8179-4b58f09a53eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:20.393452 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb0881f6-31e9-47ae-8179-4b58f09a53eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:20.393856 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb0881f6-31e9-47ae-8179-4b58f09a53eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:20.648367 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-cb0881f6-31e9-47ae-8179-4b58f09a53eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:45:20.656806 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cb0881f6-31e9-47ae-8179-4b58f09a53eb tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1579 microversion: 2.1 time: 0.278720 Sep 19 17:45:20.657277 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 656/1320] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:45:20 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1579 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:45:21.681004 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f5061729-46eb-45dd-8aed-e56f81c6358a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:21.681713 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f5061729-46eb-45dd-8aed-e56f81c6358a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:21.691814 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5061729-46eb-45dd-8aed-e56f81c6358a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:21.692311 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5061729-46eb-45dd-8aed-e56f81c6358a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:21.692760 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5061729-46eb-45dd-8aed-e56f81c6358a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:21.693472 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5061729-46eb-45dd-8aed-e56f81c6358a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:21.693940 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5061729-46eb-45dd-8aed-e56f81c6358a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:21.694371 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5061729-46eb-45dd-8aed-e56f81c6358a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:21.698124 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c610d08-85d8-46b8-92e6-dbcd57984c58] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 53452. Sep 19 17:45:21.883449 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-f5061729-46eb-45dd-8aed-e56f81c6358a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:45:21.891877 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f5061729-46eb-45dd-8aed-e56f81c6358a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1579 microversion: 2.1 time: 0.215062 Sep 19 17:45:21.892458 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 665/1321] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:45:21 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1579 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:45:22.916546 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-969d51d8-0e09-4d1f-9f4e-c12b2eb3ca48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:22.917165 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-969d51d8-0e09-4d1f-9f4e-c12b2eb3ca48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:22.924406 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-969d51d8-0e09-4d1f-9f4e-c12b2eb3ca48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:22.924891 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-969d51d8-0e09-4d1f-9f4e-c12b2eb3ca48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:22.925389 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-969d51d8-0e09-4d1f-9f4e-c12b2eb3ca48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:22.926093 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-969d51d8-0e09-4d1f-9f4e-c12b2eb3ca48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:22.926552 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-969d51d8-0e09-4d1f-9f4e-c12b2eb3ca48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:22.926983 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-969d51d8-0e09-4d1f-9f4e-c12b2eb3ca48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:22.954156 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3251fac8-070d-41b5-8405-d6fcf07fdc23 req-42b15e5a-d4bd-473f-a74b-945267676aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d561cde2-43c9-45a8-a190-51ebb242d93d", "name": "network-vif-deleted", "tag": "93892384-9312-48a0-b5ef-f79b27e3fcf1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:45:22.963512 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3251fac8-070d-41b5-8405-d6fcf07fdc23 req-42b15e5a-d4bd-473f-a74b-945267676aff service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:22.965280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3251fac8-070d-41b5-8405-d6fcf07fdc23 req-42b15e5a-d4bd-473f-a74b-945267676aff service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:22.965280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3251fac8-070d-41b5-8405-d6fcf07fdc23 req-42b15e5a-d4bd-473f-a74b-945267676aff service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:22.975800 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3251fac8-070d-41b5-8405-d6fcf07fdc23 req-42b15e5a-d4bd-473f-a74b-945267676aff service nova] Creating event network-vif-deleted:93892384-9312-48a0-b5ef-f79b27e3fcf1 for instance d561cde2-43c9-45a8-a190-51ebb242d93d on hv-cinder-84801 Sep 19 17:45:22.980784 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3251fac8-070d-41b5-8405-d6fcf07fdc23 req-42b15e5a-d4bd-473f-a74b-945267676aff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030260 Sep 19 17:45:22.988077 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 666/1322] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:45:22.993987 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-969d51d8-0e09-4d1f-9f4e-c12b2eb3ca48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:45:23.003145 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-969d51d8-0e09-4d1f-9f4e-c12b2eb3ca48 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1392 microversion: 2.1 time: 0.090833 Sep 19 17:45:23.003749 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 657/1323] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:45:22 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1392 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:45:24.033731 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:24.034439 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:24.040746 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:24.041263 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:24.041708 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:24.042404 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:24.042864 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:24.043297 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:24.074902 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:24.075387 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:24.075862 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:24.076315 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lazy-loading 'fault' on Instance uuid d561cde2-43c9-45a8-a190-51ebb242d93d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:45:24.120324 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:45:24.128183 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1fb93e36-4285-46cb-9f54-546a6e34b69b tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 200 len: 1231 microversion: 2.1 time: 0.099640 Sep 19 17:45:24.128792 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 667/1324] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:45:24 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:45:25.151476 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:25.152134 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: d561cde2-43c9-45a8-a190-51ebb242d93d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:25.158656 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:25.159129 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:25.159559 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:25.160271 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:25.160723 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:25.161139 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:25.174800 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] HTTP exception thrown: Instance d561cde2-43c9-45a8-a190-51ebb242d93d could not be found. Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Request method failure captured: Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d HTTP/1.1 Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKiybqyYga1n069x7flHG0C2cPmJ9EaKtkMsTflMdBA_aEZBYLi0Vtask6794lcunovSFC8oV9h6emEgXFRb-sk5x2kR_U4BFzeHywBvAGqgtFx2YGWHV6GBCVX0V1bcBUoNx6WQEpVq24HksaEWuquFv-aKzpKziGS7OayWaRpR8C8 Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 3fa7a842679b460f87e34a84e7d12c5f Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:45:25.176445 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3fa7a842679b460f87e34a84e7d12c5f"}]}] Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 3fa7a842679b460f87e34a84e7d12c5f Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-428104274-project Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: a695d9e178414ba294fc30fe12edf7aa Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-428104274-project Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance d561cde2-43c9-45a8-a190-51ebb242d93d could not be found. Sep 19 17:45:25.178282 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': 'd561cde2-43c9-45a8-a190-51ebb242d93d'} Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d561cde2-43c9-45a8-a190-51ebb242d93d could not be found. Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:45:25.179511 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d561cde2-43c9-45a8-a190-51ebb242d93d could not be found. Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d561cde2-43c9-45a8-a190-51ebb242d93d could not be found. Sep 19 17:45:25.181690 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:45:25.183500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Returning 404 to user: Instance d561cde2-43c9-45a8-a190-51ebb242d93d could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:45:25.183500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bde7616b-c15f-434e-b4ac-d438bc4f48ba tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d" status: 404 len: 111 microversion: 2.1 time: 0.030210 Sep 19 17:45:25.183500 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 658/1325] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:45:25 2022] GET /compute/v2.1/servers/d561cde2-43c9-45a8-a190-51ebb242d93d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:45:28.507436 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb58423d-3ca8-4bb4-9016-318730051d1c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:28.518677 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fb58423d-3ca8-4bb4-9016-318730051d1c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:28.519410 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb58423d-3ca8-4bb4-9016-318730051d1c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:28.519793 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb58423d-3ca8-4bb4-9016-318730051d1c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:28.520242 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb58423d-3ca8-4bb4-9016-318730051d1c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:28.520957 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb58423d-3ca8-4bb4-9016-318730051d1c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:28.521536 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb58423d-3ca8-4bb4-9016-318730051d1c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:28.521974 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb58423d-3ca8-4bb4-9016-318730051d1c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:28.548855 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fb58423d-3ca8-4bb4-9016-318730051d1c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 17:45:28.574354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-57a3933e-973f-4ec9-baeb-a76a63f72417 req-c4c37ecd-c2f9-404b-b09e-452677ca33dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "426d62ae-f3df-4fac-ae8c-a46f474ae96f", "tag": "727823c4-0505-44bd-b537-7bd995c24817"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:45:28.584792 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-57a3933e-973f-4ec9-baeb-a76a63f72417 req-c4c37ecd-c2f9-404b-b09e-452677ca33dd service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:28.585275 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-57a3933e-973f-4ec9-baeb-a76a63f72417 req-c4c37ecd-c2f9-404b-b09e-452677ca33dd service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:28.585710 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-57a3933e-973f-4ec9-baeb-a76a63f72417 req-c4c37ecd-c2f9-404b-b09e-452677ca33dd service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:28.597542 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-57a3933e-973f-4ec9-baeb-a76a63f72417 req-c4c37ecd-c2f9-404b-b09e-452677ca33dd service nova] Creating event network-changed:727823c4-0505-44bd-b537-7bd995c24817 for instance 426d62ae-f3df-4fac-ae8c-a46f474ae96f on hv-cinder-84801 Sep 19 17:45:28.602696 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-57a3933e-973f-4ec9-baeb-a76a63f72417 req-c4c37ecd-c2f9-404b-b09e-452677ca33dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100357 Sep 19 17:45:28.603299 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 659/1326] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 17:45:28.764520 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb58423d-3ca8-4bb4-9016-318730051d1c tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "DELETE /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 204 len: 0 microversion: 2.1 time: 0.264463 Sep 19 17:45:28.765649 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 668/1327] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:45:28 2022] DELETE /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 17:45:28.777972 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-feccf6af-4a27-49a3-8526-595f530c5b1e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:28.778834 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-feccf6af-4a27-49a3-8526-595f530c5b1e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:28.786512 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-feccf6af-4a27-49a3-8526-595f530c5b1e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:28.787274 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-feccf6af-4a27-49a3-8526-595f530c5b1e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:28.787992 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-feccf6af-4a27-49a3-8526-595f530c5b1e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:28.793983 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-feccf6af-4a27-49a3-8526-595f530c5b1e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:28.793983 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-feccf6af-4a27-49a3-8526-595f530c5b1e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:28.793983 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-feccf6af-4a27-49a3-8526-595f530c5b1e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:28.928760 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-feccf6af-4a27-49a3-8526-595f530c5b1e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:45:28.937001 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-feccf6af-4a27-49a3-8526-595f530c5b1e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1578 microversion: 2.1 time: 0.166343 Sep 19 17:45:28.938143 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 660/1328] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:45:28 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:45:29.962345 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-30d2c3de-60bb-4ca3-bfaf-c7980545c71e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:29.963046 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-30d2c3de-60bb-4ca3-bfaf-c7980545c71e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:29.969565 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d2c3de-60bb-4ca3-bfaf-c7980545c71e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:29.970063 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d2c3de-60bb-4ca3-bfaf-c7980545c71e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:29.970487 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d2c3de-60bb-4ca3-bfaf-c7980545c71e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:29.971193 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d2c3de-60bb-4ca3-bfaf-c7980545c71e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:29.971643 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d2c3de-60bb-4ca3-bfaf-c7980545c71e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:29.972090 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d2c3de-60bb-4ca3-bfaf-c7980545c71e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:30.112885 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.policy [None req-30d2c3de-60bb-4ca3-bfaf-c7980545c71e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:45:30.122827 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-30d2c3de-60bb-4ca3-bfaf-c7980545c71e tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1578 microversion: 2.1 time: 0.163287 Sep 19 17:45:30.123599 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 669/1329] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:45:29 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:45:31.147154 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3582ac8b-1f5c-4ee3-9c30-1f03bf841f05 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:31.147836 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3582ac8b-1f5c-4ee3-9c30-1f03bf841f05 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:31.154563 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3582ac8b-1f5c-4ee3-9c30-1f03bf841f05 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:31.155097 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3582ac8b-1f5c-4ee3-9c30-1f03bf841f05 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:31.155669 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3582ac8b-1f5c-4ee3-9c30-1f03bf841f05 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:31.157005 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3582ac8b-1f5c-4ee3-9c30-1f03bf841f05 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:31.157494 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3582ac8b-1f5c-4ee3-9c30-1f03bf841f05 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:31.157931 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3582ac8b-1f5c-4ee3-9c30-1f03bf841f05 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:31.296181 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-3582ac8b-1f5c-4ee3-9c30-1f03bf841f05 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:45:31.304753 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3582ac8b-1f5c-4ee3-9c30-1f03bf841f05 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1459 microversion: 2.1 time: 0.161431 Sep 19 17:45:31.320027 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 661/1330] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:45:31 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1459 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:45:31.423930 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-97a9fcce-088a-4f3b-88b2-5bbda1c53295 req-bc2b91f8-9e0a-48f6-b053-13ac07efde46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "426d62ae-f3df-4fac-ae8c-a46f474ae96f", "name": "network-vif-deleted", "tag": "727823c4-0505-44bd-b537-7bd995c24817"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 17:45:31.432103 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-97a9fcce-088a-4f3b-88b2-5bbda1c53295 req-bc2b91f8-9e0a-48f6-b053-13ac07efde46 service nova] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:31.432584 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-97a9fcce-088a-4f3b-88b2-5bbda1c53295 req-bc2b91f8-9e0a-48f6-b053-13ac07efde46 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:31.433018 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-97a9fcce-088a-4f3b-88b2-5bbda1c53295 req-bc2b91f8-9e0a-48f6-b053-13ac07efde46 service nova] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:31.446529 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-97a9fcce-088a-4f3b-88b2-5bbda1c53295 req-bc2b91f8-9e0a-48f6-b053-13ac07efde46 service nova] Creating event network-vif-deleted:727823c4-0505-44bd-b537-7bd995c24817 for instance 426d62ae-f3df-4fac-ae8c-a46f474ae96f on hv-cinder-84801 Sep 19 17:45:31.451459 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-97a9fcce-088a-4f3b-88b2-5bbda1c53295 req-bc2b91f8-9e0a-48f6-b053-13ac07efde46 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093893 Sep 19 17:45:31.452112 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 670/1331] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Sep 19 17:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 17:45:32.328855 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:32.329450 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:32.336319 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:32.336812 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:32.337261 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:32.337973 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:32.338450 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:32.338904 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:32.372124 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:32.372611 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:32.373314 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:32.373506 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lazy-loading 'fault' on Instance uuid 426d62ae-f3df-4fac-ae8c-a46f474ae96f {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 17:45:32.418108 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a695d9e178414ba294fc30fe12edf7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7a842679b460f87e34a84e7d12c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 17:45:32.426486 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5d04f32-3031-4a23-98ea-9960e1bbc308 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 200 len: 1230 microversion: 2.1 time: 0.101487 Sep 19 17:45:32.427139 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 662/1332] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:45:32 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 17:45:33.458241 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:33.459793 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: 426d62ae-f3df-4fac-ae8c-a46f474ae96f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:33.465560 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:33.466040 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:33.466472 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:33.467159 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:33.467610 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:33.468061 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:33.482284 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] HTTP exception thrown: Instance 426d62ae-f3df-4fac-ae8c-a46f474ae96f could not be found. Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Request method failure captured: Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f HTTP/1.1 Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKiybqyYga1n069x7flHG0C2cPmJ9EaKtkMsTflMdBA_aEZBYLi0Vtask6794lcunovSFC8oV9h6emEgXFRb-sk5x2kR_U4BFzeHywBvAGqgtFx2YGWHV6GBCVX0V1bcBUoNx6WQEpVq24HksaEWuquFv-aKzpKziGS7OayWaRpR8C8 Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 3fa7a842679b460f87e34a84e7d12c5f Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:45:33.484065 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3fa7a842679b460f87e34a84e7d12c5f"}]}] Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 3fa7a842679b460f87e34a84e7d12c5f Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-TestVolumeBootPattern-428104274-project Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: a695d9e178414ba294fc30fe12edf7aa Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-TestVolumeBootPattern-428104274-project Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance 426d62ae-f3df-4fac-ae8c-a46f474ae96f could not be found. Sep 19 17:45:33.485786 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': '426d62ae-f3df-4fac-ae8c-a46f474ae96f'} Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426d62ae-f3df-4fac-ae8c-a46f474ae96f could not be found. Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:45:33.490114 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426d62ae-f3df-4fac-ae8c-a46f474ae96f could not be found. Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426d62ae-f3df-4fac-ae8c-a46f474ae96f could not be found. Sep 19 17:45:33.492350 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:45:33.493811 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Returning 404 to user: Instance 426d62ae-f3df-4fac-ae8c-a46f474ae96f could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:45:33.493811 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-62d80ee9-06d9-4781-a298-f17e6096c76a tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f" status: 404 len: 111 microversion: 2.1 time: 0.031702 Sep 19 17:45:33.493811 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 671/1333] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:45:33 2022] GET /compute/v2.1/servers/426d62ae-f3df-4fac-ae8c-a46f474ae96f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:45:33.997649 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:33.998180 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:34.005241 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:34.005731 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:34.006169 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:34.006867 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:34.007326 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:34.007774 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:34.021841 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] HTTP exception thrown: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Request method failure captured: Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 HTTP/1.1 Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept: application/json Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Accept-Encoding: identity Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Connection: close Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Length: 0 Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Content-Type: application/json Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Host: 10.222.0.61 Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: Openstack-System-Scope: None Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjKKiybqyYga1n069x7flHG0C2cPmJ9EaKtkMsTflMdBA_aEZBYLi0Vtask6794lcunovSFC8oV9h6emEgXFRb-sk5x2kR_U4BFzeHywBvAGqgtFx2YGWHV6GBCVX0V1bcBUoNx6WQEpVq24HksaEWuquFv-aKzpKziGS7OayWaRpR8C8 Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Id: None Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Domain-Name: None Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Identity-Status: Confirmed Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Is-Admin-Project: True Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Id: default Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Domain-Name: Default Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Id: 3fa7a842679b460f87e34a84e7d12c5f Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Role: reader,member Sep 19 17:45:34.023532 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Roles: reader,member Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3fa7a842679b460f87e34a84e7d12c5f"}]}] Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Id: 3fa7a842679b460f87e34a84e7d12c5f Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-428104274-project Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Id: default Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Domain-Name: Default Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Id: a695d9e178414ba294fc30fe12edf7aa Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-428104274-project Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: method: > Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: exception: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:45:34.025420 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: action_args: {'id': 'faf0413e-fde3-4cb9-bed3-1dd053a94609'} Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:45:34.026610 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:45:34.028354 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Sep 19 17:45:34.030164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Returning 404 to user: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:45:34.030164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-191c04b0-b719-4db6-94f0-e318a26c7b74 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "DELETE /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 404 len: 111 microversion: 2.1 time: 0.031693 Sep 19 17:45:34.030164 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 663/1334] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Sep 19 17:45:33 2022] DELETE /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:45:34.034058 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:34.034676 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] [instance: faf0413e-fde3-4cb9-bed3-1dd053a94609] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 17:45:34.040942 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:34.041433 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:34.041878 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:34.042585 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Acquiring lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 17:45:34.043071 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 17:45:34.043505 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Lock "cb886613-25c5-4d71-85c4-935a7fe74cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 17:45:34.058183 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] HTTP exception thrown: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Request method failure captured: Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 HTTP/1.1 Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept: application/json Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Accept-Encoding: identity Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Connection: close Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Length: 0 Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Content-Type: application/json Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Host: 10.222.0.61 Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: Openstack-System-Scope: None Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjKKiybqyYga1n069x7flHG0C2cPmJ9EaKtkMsTflMdBA_aEZBYLi0Vtask6794lcunovSFC8oV9h6emEgXFRb-sk5x2kR_U4BFzeHywBvAGqgtFx2YGWHV6GBCVX0V1bcBUoNx6WQEpVq24HksaEWuquFv-aKzpKziGS7OayWaRpR8C8 Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Id: None Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Domain-Name: None Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Identity-Status: Confirmed Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Is-Admin-Project: True Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Id: default Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Domain-Name: Default Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Id: 3fa7a842679b460f87e34a84e7d12c5f Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Project-Name: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Role: reader,member Sep 19 17:45:34.059733 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Roles: reader,member Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3fa7a842679b460f87e34a84e7d12c5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3fa7a842679b460f87e34a84e7d12c5f"}]}] Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Id: 3fa7a842679b460f87e34a84e7d12c5f Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestVolumeBootPattern-428104274 Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User: tempest-TestVolumeBootPattern-428104274-project Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Id: default Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Domain-Name: Default Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Id: a695d9e178414ba294fc30fe12edf7aa Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: X-User-Name: tempest-TestVolumeBootPattern-428104274-project Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: method: > Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: exception: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:45:34.061598 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: action_args: {'id': 'faf0413e-fde3-4cb9-bed3-1dd053a94609'} Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 17:45:34.063280 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. Sep 19 17:45:34.064820 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Sep 19 17:45:34.066339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Returning 404 to user: Instance faf0413e-fde3-4cb9-bed3-1dd053a94609 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 17:45:34.066339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-83a92a68-c9db-4777-adb3-679f301e4fb0 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609" status: 404 len: 111 microversion: 2.1 time: 0.031154 Sep 19 17:45:34.066339 dv-cinder-848013-2-iscsi devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 672/1335] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Sep 19 17:45:34 2022] GET /compute/v2.1/servers/faf0413e-fde3-4cb9-bed3-1dd053a94609 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 17:45:35.593045 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da53113b-ce1a-4a5c-bbe9-3f227cb8cf27 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] Calling method '.version_select at 0x7fd4d98264c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 17:45:35.776855 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da53113b-ce1a-4a5c-bbe9-3f227cb8cf27 tempest-TestVolumeBootPattern-428104274 tempest-TestVolumeBootPattern-428104274-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1139086849" status: 202 len: 0 microversion: 2.1 time: 0.189290 Sep 19 17:45:35.777471 dv-cinder-848013-2-iscsi devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 664/1336] 10.222.0.61 () {58 vars in 1263 bytes} [Mon Sep 19 17:45:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1139086849 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)